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ABSTRACT 


The  main  purpose  of  this  study  is  to  examine  the  relationship  between  graduate 
edueation  and  the  job  performanee  of  DoD  civilian  employees.  The  thesis  focuses  on 
selected  job  performance  measures  for  all  civilian  DoD  personnel  employed  between 
1986  and  1999,  except  for  those  in  the  National  Imagery  and  Mapping  Agency  and  direct 
and  indirect  hire  civilian  employees  outside  the  50  states  and  the  District  of  Columbia. 
The  Defense  Manpower  Data  Center  (DMDC)  provided  the  personnel  data.  Performance 
measures  that  are  analyzed  include  promotion,  promotion  speed,  performance  ratings, 
earnings  and  retention.  Three  different  techniques  are  used  to  estimate  performance 
models.  First,  ordinary  least  squares  is  used  to  estimate  the  salary  and  performance  rating 
models.  Second,  binary  logit  regression  is  used  to  estimate  promotion,  retention,  and 
performance  rating  models.  Third,  survival  analysis  using  Cox  Regression  estimates  the 
speed  of  promotion  and  the  time  to  separation.  The  results  indicate  that  employees  with  a 
Master’s  or  Doctorate  earned  more  in  average  salary  but  experienced  lower  salary  growth 
than  employees  with  a  Bachelor’s  degree.  Also  advanced  degree  holders  are  promoted 
more  slowly  since  they  enter  at  a  higher  GS  grade.  Higher  educated  employees  were  also 
more  likely  to  leave  federal  service,  but  were  more  likely  to  receive  top  ratings  and 
achieve  a  supervisor  position. 
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I.  INTRODUCTION 


A.  PURPOSE  OF  THE  THESIS 

The  main  purpose  of  this  study  is  to  examine  the  relationship  between  graduate 
education  and  the  job  performance  of  Department  of  Defense  (DoD)  civilian  employees. 
The  thesis  will  focus  on  promotion  speed  and  other  selected  job  performance  measures 
for  all  civilian  DoD  personnel  employed  between  1986  and  1999,  except  for  those  in  the 
National  Imagery  and  Mapping  Agency  and  direct  and  indirect  hire  civilian  employees 
outside  the  50  states  and  the  District  of  Columbia.  The  Defense  Manpower  Data  Center 
(DMDC)  provided  the  personnel  data.  Other  performance  measures  that  are  analyzed 
include  performance  ratings,  earnings  and  retention. 

The  primary  question  for  this  analysis  is  What  is  the  effect  of  graduate  education 
on  the  job  performance  of  DoD  civilian  employees?  The  secondary  questions  that 
reinforce  the  primary  question  are:  (1)  Does  the  possession  of  a  Master’s  degree  result  in 
faster  promotion,  higher  earnings,  and  better  performance  ratings?  (2)  Does  the  effect  of 
a  Master’s  vary  among  DoD  occupations  and  functional  areas?  (3)  Does  the  DoD 
personnel  structure  reward  the  investment  in  human  capital  represented  by  the  Master’s 
degree? 

DoD  civilians  are  paid  according  to  commonly  structured  pay  tables.  The  largest 
portion  of  DoD  civilian  employees,  especially  white-collar  personnel,  is  covered  by  the 
General  Schedule  (GS)  pay  system.  This  system  is  built  on  the  concept  that  equal 
payment  will  be  provided  for  equal  work  and  that  salary  differences  between  non-federal 
employees  and  DoD  employees  will  be  compared  periodically.  Yet  a  commonly  asked 
question  is  whether  the  common  pay  table  is  sufficient  enough  to  attract,  motivate,  and 
retain  highly  educated  and  high  quality  personnel  who  have  other  opportunities  in  the 
civilian  market.  This  thesis  will  research  whether  more  highly  educated  civilian 
employees  are  paid  more  and  are  promoted  faster.  It  will  also  examine  their  retention 
behavior. 

In  September  1999,  Usan  and  Utoglu  [Ref:7]  analyzed  the  effect  of  graduate 
education  using  the  same  database.  However,  to  obtain  a  different  perspective  of  the 
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effects  of  graduate  education  on  DoD  civilian  employees’  performance,  this  thesis 
analyzes  the  same  performance  measures,  but  uses  different  methodologies.  Usan  and 
Utoglu  used  three  bivariate  logit  models  to  estimate  promotion,  retention  and 
performance  ratings  models.  In  addition,  they  estimated  the  level  of  employee  salaries 
using  a  semi-log  model.  The  pay,  promotion,  retention  and  performance  evaluation 
models  estimated  in  this  thesis  will  be  specified  differently  from  those  estimated  by  Usan 
and  Utoglu.  The  differences  between  this  thesis  and  the  research  by  Usan  and  Utoglu  are 
explained  below. 

To  analyze  promotion  outcomes,  Usan  and  Utoglu  analyzed  current  civilian 
employees  in  the  DoD  as  of  1986  and  followed  them  until  1992.  A  dummy  variable  was 
created  based  on  whether  the  employees  were  promoted  at  least  once  during  this  six-year 
period.  This  outcome  of  at  least  one  promotion  in  a  six-year  period  was  used  as  criterion 
for  tracking  the  effect  of  graduate  education  on  performance.  However,  a  superior 
measure  of  promotion  would  be  to  measure  promotion  speed  or  the  number  of 
promotions  over  a  given  period  rather  than  defining  promotion  based  on  only  a  single 
promotion  incident  over  such  a  long  period. 

As  a  measure  for  retention,  Usan  and  Utoglu  analyzed  the  retention  behavior  of 
DoD  employees  between  1986  and  1992.  If  the  employees  were  still  in  the  federal  service 
in  1992,  then  they  were  coded  as  stayers.  This  methodology  also  did  not  analyze  the 
length  of  service  of  employees  before  separation. 

As  a  third  measure  of  performance,  Usan  and  Utoglu  used  the  average 
performance  rating  of  employees  between  1986  and  1992.  Since  little  variation  was 
observed  in  performance  ratings  among  employees,  the  results  might  not  provide  precise 
estimates  of  the  relationship  between  graduate  education  and  performance  ratings. 
Therefore,  this  thesis  identifies  superior  performers  as  those  who  receive  the  highest 
performance  ratings.  Also,  high  performing  employees  are  often  placed  in  supervisory 
positions  as  a  reward  for  their  performance.  Therefore,  when  workers  are  promoted  to 
supervisors,  this  can  be  a  useful  performance  measure. 
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Lastly,  Usan  and  Utoglu  analyzed  the  1986-year  salary  level.  However,  the 
pereentage  increases  of  salary  overtime  in  real  terms  may  indicate  the  impact  of  graduate 
education  on  earnings  more  accurately. 


B,  BACKGROUND 

In  this  section  the  basic  personnel  management  system  for  DoD  civilian  personnel 
is  reviewed  to  understand  the  performance,  promotion,  and  pay  systems.  This  information 
is  useful  background  for  understanding  the  models  presented  in  this  thesis. 

1,  Pay  systems  of  DoD  civilians 

Federal  government  employees  in  the  Executive  Branch  [Ref:  10]  are  paid 
according  to  various  pay  systems.  Most  federal  employees  are  paid  under  one  of  two 
main  government  pay  systems:  (1)  the  “general  schedule”  (GS)  pay  system,  which  sets 
specific  salary  levels  for  federal  white  collar  workers,  or  (2)  the  “wage  system  rates” 
which  are  paid  to  the  government’s  craft  and  trade  (blue-collar)  workers.  The  GS  pay 
system  covers  approximately  half  of  the  federal  workforce  [Refill]. 

The  general  schedule  is  composed  of  15  grades,  or  salary  levels.  Each  grade 
includes  ten  steps  through  which  employees  advance  based  on  satisfactory  job 
performance  and  length  of  service.  Eor  all  GS  grades.  Table  1  shows  the  waiting  periods 
for  advancement  to  each  higher  step.  Employees  who  have  not  reached  the  highest  step 
for  a  particular  position  are  generally  advanced  to  the  next  step  when  they  complete  the 
required  waiting  period.  This  is  true  only  if  the  employee’s  rating  of  record  for  the  most 
recently  completed  appraisal  period  is  rated  at  least  “Eully  Successful”  or  equivalent,  and 
also  if  no  equivalent  increase  was  received  during  the  waiting  period.  Supervisors  of 
other  GS  employees  are  ordinarily  classified  at  least  one  grade  higher  than  their 
subordinates.  However,  this  doesn’t  necessarily  mean  that  supervisors  will  be  paid  more 
than  all  of  their  subordinates. 

Eor  GS  employees,  two  types  of  annual  pay  adjustments  exist:  (1)  a  national, 
across-the-board  increase;  and  (2)  a  locality-based  pay  adjustment.  The  annual  across- 
the-board  increase  is  normally  paid  in  January  of  each  year  (along  with  the  locality  pay 
adjustment).  The  amount  of  this  increase  is  normally  based  on  the  annual  percentage 
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change  in  the  Employment  Cost  Index  (ECI).  The  ECI  is  a  statistieal  indieator,  whieh  the 
Bureau  of  Eabor  statistics  maintains,  and  measures  ehanges  in  private  seetor  labor  costs. 
Similarly  the  loeality-based  pay  adjustments  are  designed  to  address  a  gap  between 
federal  and  eivilian  salaries  that  White  House  and  congressional  leaders  feel  impose  a 
hardship  on  employees  and  leave  the  government  unable  to  compete  in  the  labor  market. 

Table  1.  Step  Increases  of  GS  Personnel 


Erom  Step 

To  Step 

Weeks 

1 

2 

52 

2 

3 

52 

3 

4 

52 

4 

5 

104 

5 

6 

104 

6 

7 

104 

7 

8 

156 

8 

9 

156 

9 

10 

156 

Source:  From  [Ref:  9:p,31] 


When  an  employee  is  promoted  or  transferred  from  a  position  in  one  GS  grade  to 
a  position  in  a  higher  GS  grade,  the  individual  is  entitled  to  basic  pay  at  a  rate  not  less 
than  two  step-increases  (within-grade)  above  the  employee’s  original  basie  rate  of  pay 
before  the  promotion.  In  other  words,  a  GS-4,  step  5  must  receive,  as  a  minimum,  the  pay 
of  a  GS-4,  step  7  upon  promotion  to  GS-5. 

In  contrast  to  the  GS  pay  rates;  the  pay  of  federal  government’s  wage-system 
employees  is  fixed  as  an  hourly  rate  by  the  lead  agencies.  Pay  rates  for  wage  system 
employees  are  set  as  an  hourly  rate  and  are  legally  required  to  be  adjusted  from  time  to 
time  consistent  with  prevailing  rates.  The  wage  system’s  prevailing  rate  determinations 
are  made  on  the  basis  of  surveys  of  rates  paid  by  private  employers  in  eaeh  loeal  area  for 
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work  similar  to  that  performed  by  federal  wage  employees.  There  are  around  133  loeal 
wage  areas.  Each  wage  area  pay  scale  is  divided  into  three  classes:  WG  (worker);  WL 
(leader);  WS  (supervisor).  The  WG  and  WL  classes  of  pay  rates  each  have  15  grades  with 
5  steps  in  each. 

2.  Promotions  in  the  Federal  Service 

A  promotion  is  a  change  to  a  higher  grade  and  should  not  be  confused  with 
periodic  “within-grade  increases”  or  “quality  step  increases,”  which  provide  salary 
increases  within  the  scheduled  rates  of  the  grade.  Opportunities  for  advancement  occur 
when  new  positions  are  established  because  of  reorganization,  added  program 
responsibilities,  or  when  an  employee  vacates  a  position.  Competition  among  employees 
is  generally  required  [Ref:l  1:  p.230]. 

For  promotion  from  one  position  to  another,  the  employees  should  also  meet 
time-in-grade  requirements.  For  example,  for  advancement  to  positions  at  GS-12  or 
above,  the  candidate  must  have  completed  a  minimum  of  52  weeks  in  a  position  no  more 
than  one  grade  lower  than  the  position  to  be  filled.  For  advancement  to  positions  at  GS-6 
through  GS-11,  candidates  must  have  completed  again  a  minimum  of  52  weeks  in  a 
position  no  more  than  one  or  two  grades  lower  depending  on  the  position  grade  intervals. 
Advancements  to  positions  up  to  GS-5  have  no  restrictions  if  the  employees  completed 
52  weeks  in  the  lower  grades. 

Each  agency  must  have  a  Merit  Promotion  Plan  complying  with  the  requirements 
of  the  Office  of  Personnel  Management  (0PM).  The  main  purpose  of  the  Merit 
Promotion  Plan  is  to  ensure  the  selection  of  the  best-qualified  candidates  to  open 
positions.  Merit  promotions  should  not  be  confused  with  within-grade  pay  increases,  as 
they  involve  a  formal  move  to  a  higher  grade  [Ref:  10:  p.l59]. 

A  candidate  selected  for  a  first-level  supervisory  or  managerial  job  must  serve  a 
probationary  period  of  one  year.  The  probationary  period  for  new  managers  and 
supervisors  is  intended  to  assess  their  supervisory  and  managerial  skills  and  abilities,  not 
to  test  them  on  technical  or  program  knowledge.  First-time  supervisors  and  managers 
who  do  not  satisfactorily  complete  the  trial  period  will  be  returned  to  positions  of  no 
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lower  pay  and  grade  than  those  they  oeeupied  before  assuming  their  management  or 
supervisory  assignments. 

Although  all  promotions  must  follow  merit  proeedures,  they  do  not  all  require 
eompetition  among  employees.  Some  jobs  are  filled  by  “career  promotion.”  For  example, 
if  an  employee  has  been  selected  competitively  for  a  trainee  or  understudy  position,  or  for 
another  position  with  a  known  promotional  potential  or  career  ladder,  which  provides  for 
consecutive  promotions,  and  the  employee  performs  satisfactorily  then  the  employee  is 
eligible  for  promotion  without  additional  competition  until  the  full  performance  level  of 
the  position  is  reached. 

3.  Performance  appraisal  systems 

Federal  employees  are  subject  to  periodic  appraisals  of  their  job  performance.  The 
rating  levels  are  shown  in  Table  2.  DoD  civilians  are  classified  according  to  five 
different  rating  levels.  These  performance  appraisal  levels  can  have  an  impact  on  a  wide 
variety  of  personnel  and  employment  decisions  affecting  federal  employees.  For 
example,  employees  can  be  reassigned,  demoted,  promoted,  or  removed  from  the  job  if 
the  individual  continues  to  have  “Unsatisfactory”  performance.  The  appraisal  systems 
must  be  based  on  objective  job  related  criteria,  and  performance  standards  must  be 
developed  for  each  element  of  the  job  on  which  an  employee  is  evaluated.  If  an 
employee’s  most  recent  rating  of  record  (formal  summary  rating)  is  below  Fully 
Successful  (level  3),  the  agency  is  required  to  deny  the  employee’s  within-grade  increase. 

Table  2.  Performance  Appraisal  Levels 


Levels 

Meanings  of  Codes 

1 

Outstanding 

2 

Exceeds  Fully  Successful 

3 

Fully  Successful 

4 

Minimally  Successful 

5 

Unsatisfactory 

Source:  From  [Ref:  7] 
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c. 


ORGANIZATION  OF  THE  THESIS 


This  thesis  is  organized  into  five  chapters.  Chapter  II  briefiy  reviews  studies  of 
the  relationship  between  human  capital  and  job  performance  of  individual  companies. 
Also  this  chapter  summarizes  the  analyses  of  DoD  employees’  job  performance.  Chapter 

III  describes  the  data  set  used  in  this  thesis  and  explains  the  methodologies  used  to  model 
promotion  speed,  the  length  of  time  to  separation,  and  annual  salary  increases.  Chapter 

IV  estimates  the  performance  models  and  describes  the  results  of  the  performance 
models.  Chapter  V  summarizes  the  results  of  the  analysis  and  makes  recommendations 
for  further  research. 
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II.  LITERATURE  REVIEW 


A.  PREVIOUS  STUDIES  OF  GRADUATE  EDUCATION 

No  completely  satisfaetory  method  of  measuring  job  performanee,  or  even 
defining  it,  seems  to  exist.  Aeeording  to  human  capital  theory,  an  individual’s 
produetivity  and  earnings  inerease  with  additional  education.  Yet  studies  have  not  been 
able  to  diseriminate  between  the  various  and  often  eontradictory  explanations  for  the 
positive  relationship  between  earnings  and  edueation.  Some  questions  about  the  effect  of 
education  on  job  performance  have  been  posed  in  the  literature.  For  example,  does 
aeademie  edueation  really  develop  the  personal  oapaeities  of  employees,  or  does  it  only 
serve  as  an  element  of  a  sereening  proeess,  whieh  signals  employers  about  the  skills  of 
individuals  who  are  inherently  more  produetive?  Owing  to  sueh  questions,  many 
researehers  have  examined  the  benefits  to  employees  of  seeking  higher  edueation.  In  their 
studies,  they  have  found  some  eontradietory  results  on  the  effeets  of  edueation  on  job 
produetivity.  Some  researchers  have  found  a  high  eorrelation  between  aeademie 
aehievement  and  job  performanee.  Others  have  suggested  that  edueation  only  provides 
eredentials  or  signal,  which  help  the  firm  to  filter  job  applieants. 

David  A.  Wise,  intrigued  by  these  problems,  eondueted  two  studies  on  job 
performanee  [Refil].  In  his  first  study  he  wanted  to  answer  two  main  questions.  (1)  Was 
academic  achievement  related  to  job  performanee?  (2)  Was  this  relation  due  to  personal 
oharaeteristics  or  other  cognitive  skills  gained  in  sehool? 

To  find  answers.  Wise  estimated  a  salary  model  with  ordinary  least  squares.  The 
explanatory  variables  basically  included  the  level  of  edueation,  the  type  of  education, 
prior  employment  experienee,  aeademie  aehievement,  and  other  personal  characteristics, 
namely  leadership  ability,  soeioeeonomie  baekground,  and  desire  for  job  seeurity.  The 
results  showed  that  nonaeademie  attributes  were  as  important  as  aeademie  abilities  in 
determining  job  performanee.  He  found  leadership  ability  and  initiative  were  positively 
related  to  job  performanee  while  he  observed  a  negative  relationship  between 
performanee  and  an  individual’s  desire  for  job  seeurity  and  job  suceess.  Graduate 
edueation  was  also  eorrelated  with  higher  job  performanee  in  aecordanee  with  human 
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capital  theory.  Employees  with  graduate  degrees  and  who  were  at  the  top  5%  of  their 
elass  reeeived  the  highest  salary  inereases  in  the  model. 

In  his  second  study,  David  A.  Wise  [Ref:2]  asked  the  same  questions  as  in  his 
previous  study  with  the  same  data  and  explanatory  variables,  but  unlike  his  first  study,  he 
used  maximum  likelihood  techniques  to  estimate  the  relation  between  promotion  and 
edueation.  He  thought  that  the  rate  of  upward  movement  of  an  individual  might  be  a  more 
direet  measure  of  job  performance  than  the  rate  of  salary  inerease.  One  problem  with 
using  salary  is  that  salaries  are  assigned  to  positions  rather  than  to  individuals.  Therefore, 
salary  does  not  aceurately  indicate  an  individual  employee’s  performance.  Seeond,  salary 
was  automatically  increased  based  on  years  employed  even  if  the  employee  was  not 
promoted  from  one  level  to  the  next. 

Wise’s  results  were,  however,  eonsistent  with  his  previous  study.  The  estimated 
eoeffieient  had  the  same  sign  and  similar  magnitude  in  both  studies.  A  graduate  degree 
had  a  greater  effeet  on  the  promotion  probability  than  it  had  on  salary  even  for  the 
employees  ranked  at  the  bottom  of  the  class.  In  both  of  Wise’s  studies,  the  hypothesis  of 
“no  relationship  between  education  and  job  performance”  was  rejected.  Also 
nonacademic  characteristics  proved  to  be  as  important  as  the  effect  of  academic 
achievement  on  job  performanee. 

James  L.  Medoff  and  Katharine  G.  Abraham  found  some  interesting  results  that 
appeared  to  eontradict  human  capital  theory  [Ref:3;Ref:4].  They  wanted  to  learn  whether 
additional  earnings  resulting  from  more  human  eapital  could  be  explained  by  higher  job 
produetivity.  In  their  first  study  [Ref:3],  they  built  a  semi-log  salary  model.  The  data  was 
obtained  from  a  eomputerized  personnel  file  of  a  large  U.S.  manufaeturing  firm.  The  data 
eonsisted  of  white  males  and  included  information  on;  the  employee’s  edueation,  length 
of  serviee,  date  of  birth,  physical  work  location,  current  job  grade,  date  of  entry  into 
eurrent  job  grade,  eurrent  salary,  and  reeent  salary.  Also,  the  data  ineluded  two  measures 
of  the  employee’s  performanee  and  assessment  of  the  employee’s  potential  for 
advaneement.  The  firm,  whieh  Medoff  and  Abraham  selected  for  their  study,  did  not  use 
a  classieal  supervisor  ranking  system.  Rather,  performanee  evaluations  were  based  on  the 
consensus  of  a  committee  of  supervisors  who  evaluated  eaeh  employee  relative  to  a 
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group  of  his  or  her  peers.  In  their  study,  basic  salary  was  the  only  payment  to  the 
employees;  no  employees  received  any  bonuses  or  other  payments,  which  could  bias  the 
salary  results. 

The  explanatory  variables  in  the  salary  model  included  the  level  of  education,  pre¬ 
company  experience,  company  service,  performance  ratings,  grade  level  dummies,  and 
region  dummies.  Medoff  and  Abraham  ran  the  models  three  times.  In  the  first  run,  they 
excluded  grade  dummies  and  the  performance  rating.  In  the  second  run,  they  added  the 
grade  level  to  determine  the  difference  in  every  grade  level.  Lastly,  in  their  third  run,  they 
included  both  grade  levels  and  performance  ratings  to  analyze  the  independent  relation 
between  performance  and  the  other  explanatory  variables. 

In  the  first  model,  the  estimation  results  were  consistent  with  human  capital 
theory.  Employees  having  a  high  school  diploma  or  less  received  13%  and  23%  lower 
earnings  compared  to  college  graduates.  Having  a  Master’s  degree  or  doctorate  increased 
earnings  10%  and  21%,  respectively.  Pre-company  experience  and  years  in  service  were 
also  positively  related  to  salary. 

In  the  second  model,  which  included  grade  levels,  the  coefficients  of  the 
education  variable  dropped  significantly.  The  effect  of  a  Master’s  degree  on  salary  fell 
from  10%  to  only  2%,  which  indicated  that  the  Master’s  degree  holders  were  assigned  to 
jobs  in  higher  grades.  Similarly,  pre-company  experience  and  years  in  service  also  lost 
some  of  their  effects  on  the  salary.  Lastly,  before  adding  the  performance  ratings  to  the 
model,  Medoff  and  Abraham  assumed  that  if  a  relationship  existed  between  performance 
ratings  and  earnings,  then  the  coefficients  of  education  and  the  other  variables  in  the 
model  would  drop  to  zero.  When  the  third  model  was  run,  the  results  were  similar  to  the 
second  model,  which  implied  that  performance  ratings  could  not  explain  the  effect  of  the 
explanatory  variables,  such  as  education,  pre-company  experience,  and  years  in  service. 

In  their  second  study,  [Ref:4]  Medoff  and  Abraham  also  analyzed  the  relation 
between  experience  and  job  performance  using  cross-sectional  longitudinal  data.  They 
used  performance  rating  as  an  indicator  of  job  performance.  They  explored  whether 
higher  relative  earnings  indicated  that  more  experienced  managers  and  professionals  were 
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relatively  more  productive  than  their  less  experienced  peers.  The  same  data  from  the  first 
study  were  used  in  their  second  study. 

Using  cross-sectional  data  Medoff  and  Abraham  [Ref:  4]  built  a  semi-log  salary 
model.  The  results  were  similar  to  their  first  study.  When  the  model  controlled  for  grade 
level,  the  coefficients  of  education  dropped  significantly  from  10%  to  2%  for  a  Master’s 
and  from  24%  to  5%  for  a  Doctorate.  But  when  the  performance  rating  dummies  were 
introduced  into  the  model  within  grade  levels,  the  coefficients  did  not  move  toward  zero. 
This  result  implied  that  managers  and  professionals  who  received  higher  earnings 
performed  no  better  than  less  senior  managers  and  professionals  in  the  same  grade  levels. 
So  this  result  was  not  consistent  with  the  usual  human  capital  or  on-the-job  training 
model. 

In  their  longitudinal  data  between  1972  and  1976,  two  separate  salary  variables 
and  two  separate  performance  variables  were  modeled.  It  was  observed  that  for  those 
remaining  in  a  given  grade  level,  the  passage  of  time  affects  “within-grade-level  salary 
position”  much  differently  than  it  affects  “within-grade-level  performance  position.” 
Over  time,  while  employees  did  not  change  grade  levels,  “within-grade-level  salary” 
appears  to  rise  substantially,  while  relative  “within-grade-level  performance”  appeared  to 
remain  roughly  stable  or  deteriorated.  Again  these  results  were  contrary  to  the  human 
capital  explanation  of  the  experience-earnings  profile. 

William  R.  Bowman  and  Stephen  L.  Mehay  [Ref:6]  analyzed  the  relationship 
between  on-the-job  productivity  and  graduate  education.  The  study  used  the  promotion 
of  Navy  officers  as  the  performance  measure.  A  probit  model  estimated  the  promotion 
probability.  Bowman  and  Mehay  used  a  unique  data  consisting  of  4,471  professional  and 
technical  officers  in  the  Navy’s  Promotion  History  File  between  1985  and  1990.  This 
data,  which  provided  background  information,  were  augmented  with  supervisors’ 
evaluations  (fitness  reports)  prior  to  the  grade  4  promotion  level.  Officers  were  classified 
in  two  categories:  line  and  staff.  Line  officers  work  in  primary  occupations  like  aviation, 
ship,  and  submarine  operations.  Staff  officers  are  generally  in  administrative  jobs.  The 
career  paths  and  the  difficulty  of  jobs  are  similar  within  occupational  categories.  The 
officers  were  evaluated  or  promoted  according  to  their  relative  performance  within  their 
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own  communities  (occupational  category).  Since  the  Navy  personnel  system  is 
characterized  by  an  internal  labor  market  with  a  vertical  hierarchy,  promotion  to  grade  4 
is  the  first  significant  control  point  in  an  officer’s  career  and  involves  an  up-or-out 
decision. 

When  Bowman  and  Mehay  estimated  a  single-stage  grade  4  promotion  model, 
they  noticed  that  officers  with  any  graduate  education  were  more  likely  to  be  promoted. 
They  questioned  whether  graduate  education  was  the  sole  cause  or  whether  other 
unobserved  cognitive  and  affective  skills  caused  an  officer  to  select  the  Navy-funded, 
full-time  graduate  education  program.  Is  so,  self-selection  would  bias  the  effect  of 
education  on  the  officer  promotion  probability.  Two  sources  of  selection  were  discussed. 
First,  a  potential  administrative  bias  existed  because  the  Navy  chose  officers  for  graduate 
education  according  to  their  abilities.  Second,  officers  chose  to  attend  graduate  education 
on  the  expectation  that  the  benefits  (higher  promotion  probability)  would  be  greater  than 
the  costs  of  additional  service  time.  Both  selection  sources  could  create  a  self-selection 
bias  in  the  single-stage  promotion  model. 

In  the  promotion  model,  cognitive  abilities  were  specified  as  a  function  of  college 
grade  point  average,  a  technical  undergraduate  degree  in  science,  engineering,  or 
mathematics,  or  a  graduate  degree.  Affective  skills  were  represented  by  the  accession 
source  (the  Naval  Academy,  an  ROTC  scholarship,  the  Officer  Candidate  School  (OCS), 
or  the  enlisted  ranks).  The  model  also  included  demographic  factors,  such  as  sex  and 
race,  marital  and  family  status,  and  fiscal  year  dummies.  To  be  able  to  eliminate  selection 
bias,  the  authors  introduced  controls  to  the  model  for  academic  background  and  early 
career  performance.  These  controls  were  proxied  by  college  GPA  and  early  performance 
rating  scores  (based  on  being  recommended  for  early  promotion).  When  these  controls 
were  included  in  the  model,  the  coefficient  of  the  Master  degree  dropped  20%. 

In  addition  to  these  controls,  the  authors  also  used  a  bivariate  probit  model  to 
include  the  portion  of  each  person’s  preferences  for  education  not  captured  by  the  GPA 
and  early  performance  rating  proxies,  which  were  correlated  with  the  actual  possession  of 
a  graduate  degree  but  not  with  promotion.  To  be  able  to  capture  that  bias,  they  used  a 
probit  model  for  the  determinants  of  graduate  school  attendance.  The  attendance 
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depended  on  the  expected  returns  and  individual  characteristics  such  as  sex,  age,  marital 
status,  and  race/ethnicity.  Since  the  cost  of  attending  a  graduate  program  varied  across 
occupational  specialties,  the  sub-specialties  within  line  and  staff  occupations  were  also 
included  in  the  model.  In  some  specialties,  leaving  the  operational  environment  to  attend 
graduate  school  is  very  costly.  In  other  specialties  because  of  strong  civilian  career 
opportunities,  the  opportunity  cost  of  attending  graduate  school  is  quite  high.  Therefore, 
personal  preferences  were  proxied  by  information  in  the  data  file  about  whether  each 
officer  would  accept  an  offer  to  attend  graduate  school  if  he  or  she  were  offered  the 
program. 

The  two-stage  bivariate  probit  results  indicated  that  a  large  part  of  the  promotion 
effects  in  the  single-stage  models  was  due  to  the  selection  of  more  able  officers  into  the 
graduate  education  program.  The  positive  selection  effect  also  varied  in  two  broad 
occupational  areas.  For  line  officers,  the  Master’s  coefficient  in  the  bivariate  model  was 
25%  smaller  than  in  the  single-stage  model;  for  staff  officers  the  Master’s  coefficient  fell 
50%. 

In  the  same  study.  Bowman  and  Mehay  analyzed  the  effect  of  a  fully  funded 
graduate  program.  Because  the  fully  funded  program  generally  provided  firm  specific 
training,  they  tested  whether  the  impact  of  a  Master’s  on  promotion  was  due  to  the  firm- 
specific  training  or  to  general  training.  Bowman  and  Mehay  ran  the  single-stage  probit 
models  and  the  bivariate  probit  models  for  any  Master’s  degree  and  they  ran  the  models 
for  government-funded  degrees.  In  both  cases,  the  comparison  group  consisted  of  those 
without  a  Master’s. 

In  Table  3  and  Table  4  (compare  column  1  of  each  table)  the  return  to  a  funded 
Master’s  for  line  officers  is  nearly  double  that  for  any  Master’s.  For  staff  officers,  the 
return  is  20%  higher  than  for  any  Master’s  degrees.  These  tables  also  indicated  that  the 
selection  bias  was  greater  for  the  Navy  funded  graduate  programs  than  for  any  other 
Master’s  program.  When  the  single-stage  model  controlled  for  performance  and  ability, 
the  return  to  the  Navy  funded  Master’s  for  line  officers  decreased  about  one-half, 
whereas  it  only  dropped  about  one-third  for  any  other  Master’s;  for  staff  officers,  the 
return  to  any  Master’s  was  reduced  by  two-thirds  in  Table  3.  However,  the  return  to 
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funded  Master’s  was  redueed  by  nearly  three-quarters  in  Table  4.  From  these  results,  it 
was  eoncluded  that  both  firm-speeifie  and  general  types  of  investments  provided  a 
positive  return  to  officers  in  the  Navy. 

Table  3,  Coefficient  of  Any  Master’s  Degree  in  Single-Stage  and  Bivariate 

Probit  Models 


(1) 

No  Controls  for 
Ability/Performance 

(2) 

Controls  for 
Ability/Performance 

(3) 

Bivariate 

Probit 

Line  Officers 

0.376 

0.265 

0.198 

(0.073f 

(0.065) 

(0.077) 

r0.098f 

10.0651 

10.0561 

Staff  Officers 

0.503 

0.376 

0.188 

(0.063) 

(0.073) 

(0.108) 

10.1451 

10.0891 

10.0511 

Source:  From  [Ref:6] 

^  Standard  errors  in  parentheses. 
’’  Marginal  effects  in  brackets. 


Table  4,  Coefficient  of  Fully-Funded  Master’s  Degree  in  Single-Stage  and 

Bivariate  Probit  Models 


(1) 

No  Controls  for 
Ability/Performance 

(2) 

Controls  for 
Ability/Performance 

(3) 

Bivariate 

Probit 

Line  Officers 

0.605 

0.460 

0.221 

(0.067)" 

(0.074) 

(0.037) 

10.148f 

10.0931 

- 

Staff  Officers 

0.615 

0.440 

0.246 

(0.072) 

(0.086) 

(0.048) 

10.1721 

10.1011 

- 

Source:  From  [Ref:6] 

^  Standard  errors  in  parentheses. 
’’  Marginal  effects  in  brackets 


B,  PREVIOUS  STUDIES  ON  DOD  EMPLOYEES 
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Of  the  various  studies  about  the  relationship  between  education  and  the  job 
performance  of  DoD  civilian  employees,  most  have  found  a  positive  correlation  between 
human  capital  and  earnings.  Yet  some  studies  suggested  that  there  was  no  relation  or 
there  was  a  negative  relation  between  experience  and  relative  earnings.  Generally,  such 
results  are  consistent  with  human  capital  theories. 

Bruce  H.  Dunson  [Ref:5]  analyzed  DoD  civilian  employees  and  the  relationship 
between  earnings,  experience  and  productivity.  Actually  this  analysis  replicated  Medoff 
and  Abraham’s  studies  on  the  employees  of  the  previously  mentioned  manufacturing 
firms.  Dunson  wondered  whether  he  would  find  the  same  results  for  DoD  civilian 
employees  as  Medoff  and  Abraham  found  for  private  sector  employees.  He  questioned 
whether  more  educated  or  more  experienced  workers  earn  more  than  less  educated  and 
less  experienced  employees.  He  also  questioned  whether  earning  differentials  occurred 
within  grade  levels.  Most  importantly,  he  wanted  to  learn  whether  more  educated  and 
more  experienced  employees  would  also  be  more  productive  within  grade  levels. 

The  data  were  obtained  from  the  Department  of  Defense  Civilian  Master  and 

Transaction  File.  The  study  consisted  of  white  male  employees  working  full-time  in 

either  administrative  or  professional  jobs  in  the  DoD  in  grades  13-15.  In  his  semi-log 

earnings  model,  education  level,  prior  experience,  service  years  and  dummy  variables  for 

physical  work  locations  of  DoD  employees  were  created.  Education  level  was 

categorized  into  five  different  classes:  less  than  high  school,  high  school,  a  Bachelor 

degree,  a  Master’s  degree,  or  a  professional  degree  and  a  Doctorate.  He  used  entry  age  as 

an  indicator  of  prior  experience.  Basically,  Dunson  followed  the  same  methodology  as  in 

Medoff  and  Abraham’s  studies  and  ran  the  model  three  times.  In  the  first  run,  he 

excluded  performance  ratings  and  grades  from  the  model  and  estimated  the  coefficients 

of  the  explanatory  variables.  The  results  suggested  that  having  a  Master’s  degree  had 

little  effect  on  earnings.  In  all  cases,  having  a  Master’s  degree  increased  earnings  by  only 

11%.  On  the  other  hand,  one  more  year  of  tenure  beyond  the  mean  number  of  years 

increased  earnings  by  4  or  5%.  In  the  second  run,  grade  levels  were  introduced  to  the 

model.  The  results  suggested,  like  Abraham  and  Medoff  s  studies,  that  “within-grade 

earnings”  were  consistently  smaller  for  personnel  with  a  Master’s  or  professional  degree 

compared  to  only  a  Bachelor’s  degree.  When  the  second  model  was  run  with 
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performance  ratings  added,  Dunson  observed  that  personnel  with  higher  performance 
ratings  earned  more  than  personnel  with  poorer  performance  ratings.  But  the  difference 
between  earnings  associated  with  performance  evaluations  was  extremely  low.  Most 
importantly,  no  relationship  was  found  between  education  and  productivity.  Again  this 
result  was  consistent  with  Abraham  and  Medoff  s  studies,  which  contradicted  the  human 
capital  theory. 

In  1999,  Usan  and  Utoglu  [Ref:7]  also  examined  the  effects  of  graduate  education 
on  the  performance  of  DoD  personnel  using  several  performance  measures:  salary  level, 
promotion,  retention,  and  performance  rating.  They  estimated  the  salary  model  with  the 
Ordinary  Least  Square  (OLS)  technique.  The  other  models  were  analyzed  using  binary 
logit  techniques.  The  same  data  was  used  in  this  thesis  and  in  the  Usan  and  Utoglu  study 
provided  by  the  Defense  Manpower  Data  Center.  DMDC  provided  two  personnel  files  to 
profile  DoD  Civilian  personnel.  These  two  files  have  similar  data  elements.  Usan  and 
Utoglu  merged  the  two  files  for  personnel  working  in  the  DoD  between  1986  and  1999. 
The  data  consisted  of  observations  made  on  DoD  employees  every  two  years.  The  data 
were  restricted  to  personnel  with  at  least  a  Bachelor’s  degree. 

Usan  and  Utoglu  built  a  semi-log  salary  model  to  cover  all  employees  in  1986. 
Background  variables  were  included  to  account  for  differences  in  education.  Since 
experience  highly  affected  earnings,  they  used  federal  years  in  the  federal  service  and 
prior  service  years  as  indicators  of  experience  in  the  federal  service.  Also,  because 
federal  salaries  varied  across  regions  due  to  different  economic  conditions,  regional 
dummy  variables  were  included  in  the  model.  Veterans  were  also  included  in  the  model 
to  capture  the  impact  of  the  DoD’s  veteran’s  civilian  hiring  preference.  To  capture  the 
differences  between  different  occupational  categories,  occupational  dummies  were  also 
used  in  the  model.  With  the  expectation  that  supervisory  status  had  a  positive  effect  on 
the  earnings,  the  supervisor  status  variable  was  also  added  to  the  model. 

When  Usan  and  Utoglu  ran  their  model  without  controling  for  grade  levels,  they 
found  that  personnel  with  a  Master’s  or  Doctorate  earned  5%  and  16%  more, 
respectively,  than  personnel  with  a  Bachelor’s  degree.  In  the  second  run  of  the  model 
when  grades  were  introduced  to  the  model,  the  effect  of  a  Master’s  degree  and  a 
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Doctorate  fell  to  only  0.3%  and  4%,  respectively.  These  results  suggested  that  the  higher 
earnings  for  employees  with  a  Master  and  Doctorate  degree  resulted  beeause  the  more 
highly  edueated  eandidates  entered  at  higher  grades,  which  were  eorrelated  with  higher 
salary.  This  salary  model  has  one  weakness:  the  authors  did  not  attempt  to  track  the 
pereentage  change  of  employee’s  annual  salary  over  time. 

For  the  promotion  performance  measure,  Usan  and  Utoglu  used  maximum 
likelihood  techniques  to  estimate  the  probability  of  a  partieular  individual  being 
promoted  between  1986  and  1992.  The  basic  logit  equation  they  used  can  be  written  as 
follows: 


Li  =  In  (P i/1 -Pi)  =B„  +  BX+E 


L  represented  the  logit,  which  is  In  (Pi/1 -Pi)  or  the  log-odds  ratio  of  being 
promoted.  The  eonstant  term  (intercept)  Bo  was  the  value  of  L  if  X  were  zero.  B  was  the 
ehange  in  L  for  a  ehange  in  X.  X  represented  all  the  explanatory  variables  in  the  model. 
The  authors  used  the  cumulative  logistic  distribution  function  to  determine  the  promotion 
probability  [Ref:9] 


Pi  =  1/1+6^’^°^^^^ 


Usan  and  Utoglu  also  looked  at  the  promotion  histories  of  employees  between 
1986  and  1992.  For  this  period,  they  examined  the  individuals’  promotion  dates.  If 
employees  were  promoted  between  these  years,  a  binary  dependent  variable  for 
promotion  was  created  and  took  the  value  of  1;  otherwise,  it  took  the  value  of  0.  Four 
speeifications  were  examined  in  the  model.  In  the  first  specification,  they  ran  the  model 
without  any  controls  for  grade  levels  and  performanee  ratings.  In  this  model,  they  found 
that  employees  with  a  Master’s  or  Doctorate  were  less  likely  to  be  promoted  than 
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employees  with  a  Baehelor’s  degree.  Sinee  the  parameter  estimates  indieated  the  odds 
ratio  of  being  promoted,  the  partial  effeets^  were  eomputed.  Employees  with  a  Master’s 
degree  or  Doetorate  were  2%  and  6%,  respeetively,  less  likely  to  promote.  But  when  the 
grade  levels  were  eontrolled,  the  effeet  of  graduate  edueation  on  promotion  beeame 
positive.  This  result  showed  that  sinee  employees  with  a  Master’s  or  Doetorate  were 
initially  placed  in  higher  grades,  advancing  in  their  career  path  was  more  difficult  for 
them. 

In  the  third  and  fourth  specifications  of  the  promotion  model,  similar  results  were 
found  as  in  the  previous  two  specifications.  Without  control  for  grade  levels  and  rating 
level,  the  parameter  estimates  for  Master’s  and  Doctorate’s  were  negative  but  smaller 
than  in  the  first  specification.  This  implied  that  no  relation  between  job  performance  and 
Master’s  or  Doctorate’s  existed.  Similarly,  in  the  fourth  specification  when  the  model 
controlled  for  grades  and  performance  ratings,  the  parameter  estimates  of  the  Master’s 
and  Doctorate’s  became  positive,  but  with  a  smaller  partial  effect  on  the  promotion 
probability  than  in  the  second  specification.  Generally,  education  was  statistically 
significant  and  more  educated  personnel  were  less  likely  to  be  promoted  because  they 
started  in  higher-level  positions.  The  method  Usan  and  Utoglu  used  was  weak  because 
the  promotion  probability  did  not  calculate  the  time  to  promotion.  In  a  six-year  period, 
one  employee  could  receive  more  than  one  promotion,  so  this  model  did  not  capture 
promotion  speed.  The  effect  of  a  Master’s  might  be  underestimated. 

Usan  and  Utoglu  also  estimated  a  retention  model  using  maximum  likelihood 
techniques.  Individual  characteristics  like  sex,  race,  age  and  veteran  status  were  used  in 
the  retention  models.  Usan  and  Utoglu  used  different  functional  areas  such  as  capturing 
to  capture  differences  between  work  environments.  Education  levels  and  federal  service 
years  were  also  considered  as  well  as  the  average  performance  ratings  of  available  years. 
Similar  to  the  promotion  model,  Usan  and  Utoglu  tracked  employees  between  1986  and 
1992  and  examined  the  employee’s  decisions  to  stay  or  leave  during  this  period.  If 

1  The  partial  effect  of  each  explanatory  variable  is  the  difference  between  the  probability 
of  the  base  case  (all  dummy  variables  set  to  zero  and  continuous  variables  set  to  their 
means)  and  the  probability  of  the  case  where  each  explanatory  variable  is  increased  by 
one  unit  while  all  other  variables  remain  at  their  base  levels. 
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employees  were  still  in  the  federal  serviee  in  1992,  then  the  retention  variable  was  eoded 
1;  otherwise  it  took  the  value  of  0.  They  excluded  employees  with  more  than  15  years  of 
service  from  the  analysis  because  of  the  powerful  influence  of  retirement  benefits  on 
employees’  stay  or  leave  decisions. 

They  estimated  two  retention  models:  one  for  all  employees  and  one  restricted  to 
those  who  were  newly  hired  in  1986.  The  coefficients  obtained  from  these  two  models 
also  were  converted  to  partial  effects.  Employees  with  a  Master’s  or  Doctorate  were  1.5% 
more  likely  to  leave  the  service  compared  to  employees  with  a  Bachelor’s  degree, 
holding  all  other  variables  constant.  For  new  hires,  similar  results  were  found:  both 
Master’s  and  Doctorate  degree  holders  were  5%  more  likely  to  leave  the  service  than 
those  with  a  Bachelor’s  degree.  Consequently,  these  results  confirmed  the  economic 
theories  that  the  higher  educated  and  younger  employees  were  more  mobile  in  the  job 
market. 

Usan  and  Utoglu  also  estimated  a  performance-rating  model  with  a  maximum 
likelihood  technique.  The  average  of  all  ratings  between  1986  and  1994  were  calculated 
for  all  employees’  data  and  for  new  hires  in  1986.  Employees  whose  ratings  exceeded 
this  average  were  coded  1;  otherwise  they  were  coded  0  for  the  dependent  variable. 
Similar  explanatory  variables  were  used  for  both  models,  but  service  years  were  not 
included  in  the  model  for  1986  new  hires.  Elsan  and  Utoglu  found  that  employees  with  a 
Master’s  and  a  Doctorate  were  significantly  more  likely  to  receive  higher  performance 
ratings  than  employees  with  a  Bachelor’s  degree.  This  result  supported  the  hypothesis 
that  more  education  improved  an  individual’s  adaptability  or  ability  to  cope  with  job 
demands  and  became  an  important  determinant  of  career  success. 

As  a  summary  of  all  these  models.  Master’s  degree  holders  earned  higher  annual 
salaries  and  were  more  likely  to  promote.  They  were  also  more  productive  despite  the 
findings  of  Dunson  (1985)  and  Medoff  and  Abraham  (1980)  that  there  was  no  relation 
between  human  capital  and  on-the-job  performance. 

Eastly,  Beth  Asch  [Ref: 8]  conducted  a  detailed  study  of  the  pay,  promotion  and 
retention  of  DoD  civilian  employees.  She  wanted  to  explore  whether  DoD  pay  and 
promotion  systems  were  efficient  enough  to  attract,  to  motivate  and  to  retain  more  highly 
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qualified  workers.  She  analyzed  whether  higher-educated  people  were  paid  more, 
promoted  faster  and  stayed  longer.  She  used  the  DMDC  personnel  files  of  civil  service 
GS  personnel.  The  data  she  used  tracked  individuals  who  entered  and  reentered  the  DoD 
civil  service  between  fiscal  1982  and  fiscal  1996.  The  data  consisted  of  information  on 
entry  characteristics,  and  how  these  characteristics  varied  over  each  individual’s  career, 
on  pay  levels,  on  promotion  events  and  timing,  and  on  the  timing  of  exits  from  the  DoD 
civil  service.  She  tracked  two  different  cohorts  to  explain  the  differences  before  and  after 
the  DoD  personnel  drawdown.  The  fiscal  1988  cohort  included  31,912  civil  service 
employees  who  entered  or  reentered  in  1988.  The  fiscal  1992  cohort  consisted  of  19,744 
civil  service  employees  who  entered  or  reentered  in  1992. 

Asch  used  three  measures  of  personnel  quality:  education,  supervisor  rating  and 
promotion  speed.  She  also  assessed  the  advantages  and  disadvantages  of  these  measures. 
For  example,  education  level  was  measured  with  error  in  the  DMDC  dataset.  To 
eliminate  possible  biases  related  to  education  level,  she  used  only  the  entry  education 
level,  which  appeared  to  be  measured  accurately.  Supervisor  ratings  were  used  to  see 
how  well  employees  performed  in  their  jobs  from  the  supervisors’  perspectives. 
Unfortunately,  such  ratings  did  not  provide  much  variation  and  were  missing  for  those 
who  were  in  their  first  year  of  service.  Promotion  speed  provided  more  variation  across 
personnel  and  captured  how  well  matched  the  employees  were  with  the  civil  service  jobs. 
However,  promotion  speed  was  observed  only  for  those  who  stayed  in  the  service,  which 
could  lead  to  biased  results.  Someone  who  did  not  leave  the  service,  might  have  a  taste 
for  the  civil  service,  so  the  effects  could  be  overstated.  In  her  study,  Asch  used  some 
statistical  techniques  to  overcome  these  weaknesses. 

In  the  salary  model,  she  used  ordinary  least-squares  regressions  to  measure  the 
effect  of  education  on  salary.  To  test  for  biases,  she  analyzed  each  cohort  to  a  certain 
point;  if  there  were  some  differences  in  the  estimates,  then  there  could  be  a  selection  bias. 
She  divided  each  cohort  data  into  two  groups:  those  who  separated  at  year  t,  and  those 
who  stayed  beyond  year  t.  For  the  fiscal  1988  cohort,  she  estimated  the  results  for 
employees  who  stayed  until  YOS  8  or  beyond.  For  the  fiscal  1992  cohort,  she  estimated 
the  equations  until  YOS  4  and  beyond.  If  the  results  did  not  differ  much,  then  a  selection 
bias  was  not  a  serious  problem. 


21 


Table  5  describes  the  variables  used  in  the  Asch  study.  Table  6  displays  some  of 
her  results.  For  the  fiscal  1988  cohort,  employees  with  a  Master’s  degree,  who  stayed 
beyond  YOS  8,  earned  7.3  %  more  than  employees  with  no  college  education.  Employees 
with  a  Master’s  degree  who  separated  at  YOS  8  earned  5.3  %  more  than  non-college 
graduates.  For  the  fiscal  1992  cohort,  similar  results  were  estimated  (see  Table  6.  She 
pointed  out  that  the  results  for  education  might  be  underestimated  because  bonuses  were 
excluded  from  the  earnings  measure.  The  names  of  the  variables  used  in  Asch  study  are 
listed  below. 

Table  5,  Names  of  the  Variables  used  in  the  Asch  Study 


Names 

Definition 

MNYOSO 

Months  in  service  at  entry 

MNPROMl 

Months  to  first  promotion 

CUMRATl 

Cumulative  fraction  of  “outstanding”  ratings 

CUMRAT2 

Cumulative  fraction  of  “exceeds  fully  successful”  ratings 

CHAVRAT 

Cumulative  number  of  years  employees  received  ratings 

DMDCVET 

Prior  military  service 

EGRADE 

Entry  grade 

SOMECOL 

Education=  Some  college  at  entry 

AADEG 

Education=Associate  degree  at  entry 

BADEG 

Education=Bachelor  degree  at  entry 

ABOVBA 

Education=Above  Bachelor  degree  at  entry 

MA 

Education=Master  degree  at  entry 

PH 

Education=Doctorate  degree  at  entry 

TPROMl 

Months  to  first  promotion 

TPROM2 

Months  to  second  promotion 

TPROM3 

Months  to  third  promotion 

TPROM4 

Months  to  fourth  promotion 

Source:  [Ref:8] 
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Table  6.  Ordinary-Least  Squares  Regression  Results  from  Asch,  by  Entry  Cohort 

(Dependent  Variable  =  Log  (Annual  Salary) 


FY88  COHORT  FY92  COHORT 

Beyond  YOS  8  LeftatYOS8  Beyond  YOS  4  LeftatYOS4 


Estimate 

Std. 

Error 

Estimate 

Std. 

Error 

Estimate 

Std. 

Error 

Estimate 

Std. 

Error 

SOMECOL 

0.017* 

0.001 

0.008 

0.004 

0.006* 

0.003 

0.021** 

0.009 

AADEG 

0.022* 

0.002 

0.011 

0.008 

0.050* 

0.005 

0.047* 

0.017 

BADEG 

0.077* 

0.002 

0.078* 

0.006 

0.062* 

0.004 

0.011 

0.011 

ABOVBA 

0.107* 

0.003 

0.077* 

0.011 

0.081* 

0.007 

0.030 

0.026 

MA 

0.073* 

0.002 

0.058* 

0.009 

0.056* 

0.005 

0.068* 

0.020 

PHD 

0.116* 

0.005 

0.069* 

0.019 

0.078* 

0.010 

0.064 

0.045 

N 

103,741 

11,687 

33,629 

8,647 

Mean  Dep.  Variable  10.257 

10.158 

10.140 

9.871 

E-Statistie 

7437.688 

557.763 

1797.523 

170.225 

R-squared 

.843 

.783 

.785 

.578 

Note:  *  =  Statistieal  signifieanee  at  one  pereent  level 
**  =  Statistieal  signifieanee  at  five  pereent  level 

Source:  [Ref:8] 


To  analyze  promotion  speed,  Aseh  used  Cox  regression  models  of  months  to  first 
promotion  and  months  to  seeond  promotion.  The  promotion  speed  ean  be  obtained  from 
the  Risk  Ratio  eolumn  of  Table  7.  For  example,  the  Risk  Ratio  for  AADG  (Assoeiate’s 
degree)  for  the  FY88  eohort  is  1.185,  whieh  is  greater  than  1.  This  means  that  the 
probability  of  a  first  promotion  is  18.5  pereent  higher  for  those  with  an  assoeiate  degree 
than  it  is  for  those  with  no  higher  edueation.  Similarly,  the  hazard  of  first  promotion  for 
employees  with  a  Master’s  degree  for  FY88  eohort  was  44.7  pereent  higher  than 
employees  with  no  higher  edueation.  The  hazard  of  seeond  promotion  for  employees 
with  a  Master’s  degree  was  still  13.4  %  higher  than  the  employees  with  no  higher 
edueation,  but  the  probability  beeame  smaller. 
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Table  7.  Cox  Regression  Model  Estimates  of  Months  to  First  and 

Second  Promotion,  1988, 

First  Promotion  Second  Promotion 

Estimate  Std.  Err  Risk  Ratio  Estimate  Std.  Err  Risk  Ratio 


MNYOSO 

0.009* 

0.001 

1.009 

0.023* 

0.001 

1.023 

MNPROMl 

-0.023* 

0.001 

0.977 

CUMRATl 

0.269* 

0.030 

1.309 

0.318* 

0.034 

1.374 

CUMRAT2 

0.125* 

0.024 

1.133 

0.109* 

0.029 

1.115 

CHAVRAT 

0.040** 

0.021 

1.041 

0.122* 

0.035 

1.130 

DMDCVET 

0.110* 

0.026 

1.116 

0.033 

0.036 

1.034 

SOMECOL 

0.090* 

0.020 

1.094 

0.065** 

0.027 

1.067 

AADEG 

0.170* 

0.037 

1.185 

0.108** 

0.050 

1.114 

BADEG 

0.415* 

0.027 

1.515 

0.239* 

0.036 

1.271 

ABOVBA 

0.447 

0.053 

1.564 

0.159** 

0.070 

1.172 

MA 

0.369* 

0.044 

1.447 

0.126** 

0.061 

1.134 

PHD 

0.275* 

0.101 

1.317 

0.381** 

0.188 

1.464 

N  28,350  17,423 

%Censored  35.5  39.5 

-2  log  367132.2*  169934.5* 

Note:  *=significant  at  one  percent  level 
**=  significant  at  live  percent  level 

Source:  [Ref: 8] 

For  1992  cohort,  similar  results  were  found  for  first  promotion  and  second 
promotion  in  Table  8.  The  probability  of  first  and  second  promotion  for  employees  with 
a  Master’s  degree  were  57.9%  and  25%,  respectively,  higher  than  for  employees  with  no 
higher  education. 
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Table  8,  Cox  Regression  Model  Estimates  of  Months  to  First  and  Second 

Promotion,  1992 

First  Promotion  Second  Promotion 

Estimate  Std.Err  Risk  Ratio  Estimate  Std.Err  Risk  Ratio 


MNYOSO 

-0.009* 

0.001 

0.991 

0.027* 

0.003 

1.027 

MNPROMl 

0.055* 

0.003 

0.946 

CUMRATl 

0.297* 

0.039 

1.345 

0.135* 

0.049 

1.144 

CUMRAT2 

0.218* 

0.039 

1.244 

0.036 

0.047 

1.036 

CHAVRAT 

-0.208* 

0.043 

0.813 

0.065 

0.065 

1.067 

DMDCVET 

0.190* 

0.037 

1.209 

-0.008 

0.058 

0.992 

SOMECOL 

0.247* 

0.033 

1.280 

1.138* 

0.051 

1.148 

AADEG 

0.213* 

0.060 

1.237 

0.067* 

0.093 

1.070 

BADEG 

0.429* 

0.038 

1.536 

0.258** 

1.107 

1.294 

ABOVBA 

0.454* 

0.078 

1.574 

0.258** 

0.107 

1.294 

MA 

0.457* 

0.057 

1.579 

0.223* 

0.086 

1.250 

PHD 

0.108* 

0.136 

1.114 

-0.228 

0.392 

0.797 

N  16,427  7962 

%Censored  51.82  49.76 

-2  log  123849.5*  2646.42* 

Note:  *  =signiticant  at  one  percent  level 
**=signilicant  at  five  percent  level 

Source:  [Ref: 8] 

For  retention,  Asch  examined  the  length  of  time  until  separation  for  each  cohort. 

She  again  used  the  Cox  regression  model  of  months  until  separation.  In  her  retention 

model  for  each  cohort,  she  analyzed  two  specifications.  The  first  specification,  in 

addition  to  demographics,  occupations,  and  job  locations,  included  three  quality  measures 

(entry  education,  supervisor  rating,  and  months  until  each  promotion).  The  second 

25 


specification  excluded  months  until  each  promotion.  For  1988  cohort,  when  promotion 
speed  was  included  in  the  model,  the  probability  of  separation  for  MA’s  and  Ph.D.’s  was 
38.3%  and  50%,  respectively  as  shown  in  Table  9.  However,  the  hazard  of  separation  for 
a  Master’s  or  a  Doctorate  decreased  to  26.5%  and  29.3%,  respectively  when  promotion 
speed  was  excluded  from  the  model.  This  result  indicated  that  employees  who  promoted 
slowly  stayed  for  shorter  periods.  Table  10  shows  similar  results  for  graduate  education 
for  1992  cohort  that  supported  the  lower  retention  of  the  employees  in  1988  cohort. 

Table  9,  Cox-Regression-Model  Estimates  of  Months  to  Separation,  FY88  Cohort 


Includes  Promotion  Speed  Excludes  Promotion  Speed 
Estimate  Std.Err.  Risk  Ratio  Estimate  Std.Err.  Risk  Ratio 


CUMRATl 

0.409* 

0.032 

1.506 

-603* 

0.033 

0.547 

CUMRAT2 

0.347* 

0.028 

1.415 

-0.409* 

0.028 

0.665 

TPROMl 

-0.051* 

0.001 

0.950 

TPROM2 

-0.054* 

0.001 

0.947 

TPROM3 

-0.056* 

0.001 

0.910 

TPROM4 

-0.094* 

0.002 

0.910 

MNYOS 

-0.005* 

0.000 

0.995 

-0.003 

0.000 

0.997 

CHAVRAT 

-0.201* 

0.023 

0.818 

-1.392* 

0.024 

0.249 

DMDCVET 

-0.422* 

0.025 

0.656 

0.010 

0.025 

1.010 

EDMIS 

0.351 

0.335 

1.420 

-0.184 

0.317 

0.832 

SOMECOE 

0.013 

0.019 

1.013 

0.014 

0.019 

1.015 

AADEG 

-0.017* 

0.038 

0.983 

-0.086** 

0.037 

0.918 

BADEG 

0.135* 

0.027 

1.145 

-0.020 

0.026 

0.980 

ABOVBA 

0.195* 

0.057 

1.216 

0.035 

0.056 

1.036 

MA 

0.324* 

0.045 

1.383 

0.235 

0.043 

1.265 

PHD 

0.406 

0.109 

1.500 

0.257* 

0.105 

1.293 

N  28,786  32,206 

%Censored  41.1  43.1 

2  log  41209  9585.4 

Note:  *  =significant  at  the  1% 
**  =  significant  at  the  5% 

Source:  [Ref:8] 
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Table  10,  Cox  Regression  Model  Estimates  of  Months  to  Separation,  FY92 

Cohort 

Includes  Promotion  Speed  Exeludes  Promotion  Speed 
Estimate  Std.Err.  Risk  Ratio  Estimate  Std.Err.  Risk  Ratio 


CUMRATl 

0.745* 

0.043 

2.107 

0.065 

0.039 

1.067 

CUMRAT2 

0.718* 

0.045 

2.051 

0.183* 

0.040 

1,200 

TPROMl 

-0.080* 

0.001 

0.923 

TPROM2 

-0.159* 

0.003 

0.853 

MNYOS 

-0.002* 

0.001 

0.998 

-0.031 

0.001 

0.970 

CHAVRAT 

-1.178* 

0.057 

0.308 

-2.976* 

0.055 

0.051 

DMDCVFT 

-0.422* 

0.025 

0.656 

0.010 

0.025 

1.010 

SOMFCOF 

0.009 

0.029 

1.009 

-0.089 

0.027 

0.915 

AADFG 

-0.052 

0.056 

0.949 

-1.131* 

0.051 

0.877 

BADFG 

-0.043* 

0.037 

0.958 

-0.067** 

0.034 

0.935 

ABOVBA 

0.143* 

0.092 

1.154 

0.006 

0.086 

0.994 

MA 

0.054* 

0.064 

1.056 

0.017 

0.059 

1.017 

PHD 

0.112 

0.159 

1.118 

-0.106 

0.144 

0.900 

N  17,389  19,914 

%Censored  49.88  49.7 

-2  log  131499.48*  165666.64* 

Note;  *  =significant  at  one  percent 
**  =  signifieant  at  five  percent 

Source:  [Ref:8] 

In  summary,  Aseh’s  analysis  of  both  the  FY88  and  FY92  cohorts  indicated  that 
higher  edueated  employees  were  generally  paid  more.  Furthermore,  although  employees 
with  any  college  education  were  promoted  faster  than  employees  with  no  eollege, 
employees  with  a  Master’s  degree  or  Doetorate  were  not  found  to  always  promote  faster 
than  those  with  only  a  Baehelor’s  degree.  The  retention  of  employees  with  a  Master’s  or 
Doctorate  degree  was  also  poor  for  eaeh  cohort.  The  evidenee  on  the  retention  of  the 
employees  with  a  Master’s  or  Doctorate  indicated  that  they  had  superior  civilian  job 
opportunities  or  their  slower  promotion  speed  translated  into  poorer  retention. 
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III.  DATA  AND  METHODOLOGY 


This  chapter  describes  the  data  set  and  the  methodology  that  guides  the 
speeifieation  of  the  models.  It  also  provides  deseriptive  statistics  for  each  data  set  used  to 
estimate  the  various  performance  models. 

A,  DATA  DESCRIPTION 

This  study  uses  the  same  data  that  Usan  and  Utoglu  [Ref:7]  used  in  their  study. 
The  data  is  provided  by  the  Defense  Manpower  Data  Center  (DMDC).  The  DMDC  data 
eontains  two  different  data  files:  (1)  an  inventory  (current  status)  file,  and  (2)  a 
transactions  (dynamic)  file.  Appendix  A  lists  the  data  elements  that  were  obtained  for 
employees.  The  two  files  provide  information  about  DoD  civilian  personnel  employed 
between  1986  and  1999,  except  for  those  employees  in  the  National  Imagery  and 
Mapping  Agency  and  those  employed  as  direet  and  indirect  hire  civilian  employees 
outside  the  50  states  and  the  District  of  Columbia.  For  this  study,  the  two  files  have  been 
merged  into  one  file  including  only  selected  variables.  This  new  file  ineluded  only  full¬ 
time,  career,  and  career  eonditional  employees  with  at  least  a  B.A.  or  B.S.  and  who  were 
paid  under  the  General  Schedule  or  General  Management  (GM)  pay  systems.  The 
employees  were  tracked  between  1986  and  1998  in  two-year  intervals.  The  employees’ 
data  information  is  available  in  this  new  file  through  February  1999.  This  file  was 
eonverted  into  a  SAS  (Statistical  Application  Software)  file  for  the  statistieal  analysis. 

The  raw  data  file  included  213,482  observations  and  41  data  elements.  The  data 
elements  consisted  of  personal  demographies  and  service  baekground  information  sueh  as 
sex,  raee,  age,  education  years,  veteran  status,  federal  service  years,  funetional  areas,  and 
work  region.  A  full  list  of  data  elements  is  provided  in  Appendix  A.  In  the  data  files  some 
missing  values  and  also  miseoded  values,  which  might  bias  the  analysis,  exist.  For 
example,  annual  salaries  in  1994  and  1996  were  eoded  in  four  digits  whereas  all  other 
annual  salaries  were  eoded  in  five  digits.  Therefore,  some  amendments  have  been  made 
to  the  raw  data.  Descriptive  statistics  of  data  are  provided  in  Table  11. 
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Table  11.  Descriptive  Statistics  of  DoD  Civilian  Personnel  As  of 

September  1986  (Inventory  Data) 


Variables 

Classification 

Number 

% 

Male 

162,339 

76.0 

Sex 

Female 

51,143 

24.0 

Raee 

White 

178,075 

83.4 

Black 

17,455 

8.2 

Hispanic 

6,454 

3.0 

Other 

11,498 

5.4 

Veteran 

Yes 

79,296 

37.1 

No 

134,186 

62.9 

Ageney 

Army 

82,129 

38.5 

Navy* 

62,887 

29.5 

Air  Force 

42,546 

19.9 

Other  DoD 

25,920 

12.1 

Edueation 

BA/BS 

162,165 

76.0 

MA/MS 

44,707 

20.9 

Ph.D. 

6,610 

3.1 

Pay  Plan 

GS 

174,424 

81.7 

GM 

39,058 

18.3 

Supervisory 

Yes 

54,261 

25.4 

Status 

No 

159,221 

74.6 

Occupational 

Professionals 

112,318 

52.6 

Category 

Administrative 

74,377 

34.8 

Technical 

14,226 

6.7 

Clerical 

12,013 

5.6 

Other 

548 

0.3 

*Includes  Marine  Corps 

Source:  [Ref:  7] 
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B,  METHODOLOGY 

The  purpose  of  this  thesis  is  to  investigate  the  relationship  between  graduate 
edueation  and  job  performanee  of  DoD  eivilian  employees.  Sinee  it  is  diffieult  to  measure 
the  job  performanee  of  serviee  employees,  some  imperfeet  measures  must  be  used  to 
gauge  differenees  in  employees’  job  performanee  in  the  DoD.  These  measures  of  job 
performanee  inelude  real  annual  salary  level,  promotion,  retention,  and  performanee 
ratings. 

For  the  salary  model,  the  pereentage  inerease  of  real  annual  salary  is  measured 
only  for  those  hired  in  1986.  Also,  the  average  annual  salary  of  employees  is  used  for  the 
same  employees  hired  in  1986.  The  salary  models  eould  only  take  into  aeeount  basie 
annual  salaries  beeause  bonuses  were  not  ineluded  in  the  data.  Therefore,  the  results  may 
underestimate  the  effeet  of  graduate  edueation  on  pay. 

The  general  approaeh  for  analyzing  retention  and  promotion  is  to  estimate  binary 
logit  models  that  foeus  on  the  faetors  that  influenee  the  probability  of  retention  or 
promotion.  However,  these  models  are  weak  in  two  aspects.  First,  logit  models  consider 
only  the  occurrence  of  some  event  such  as  promotion  or  separation  from  the  service 
during  a  fixed  period,  but  do  not  consider  the  length  of  time  until  these  events.  Second, 
logit  models  do  not  consider  censored  data.  On  the  other  hand,  survival  analysis  accounts 
for  both  the  occurrence  and  the  timing  of  promotions  so  that  the  variation  in  timing  can 
also  be  explained.  Furthermore,  survival  methods  account  for  censored  data.  Censoring 
occurs  when  the  data  end  before  the  event  occurs.  For  example,  in  the  separation  case,  an 
employee  may  not  have  separated  by  1999  when  the  data  ended.  While  the  employee 
will  separate  from  the  civil  service  eventually,  the  separation  event  is  not  observed  in  the 
data.  In  the  promotion  case,  censoring  might  occur  because  either  the  employee  did  not 
receive  a  promotion  before  1999  or  the  employee  might  have  separated  before  being 
promoted.  In  the  former  case,  the  employee  might  have  been  promoted  after  1999,  but 
this  is  not  observed  in  the  data  set.  Accounting  for  censoring  is  important  because  large 
numbers  of  observations  may  be  censored  and  serious  biases  in  logit  model  estimates 
may  result.  Therefore,  in  this  thesis,  both  logit  models  and  survival  models  are  estimated 
to  see  the  different  effects  of  the  same  variables  in  two  different  models. 
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For  the  promotion  model  two  different  estimates  are  used  based  on  employees 
hired  in  1986.  The  first  model,  one  ealculates  the  promotion  probability  of  employees  in 
1992  using  binary  logit  model.  The  second  model  estimates  the  time  to  first  promotion 
and  the  probability  of  promotion  by  survival  methods. 

For  the  retention  model  two  models  are  again  used  to  estimate  the  effects  of 
graduate  education  and  other  personal  traits  on  the  voluntary  retention  decisions  of  DoD 
employees.  The  first  model  estimates  the  retention  probability  of  employees  in  1992.  the 
second,  a  survival  model  estimates  the  length  of  time  until  separation  and  the  probability 
of  separation  from  the  federal  civilian  service. 

Two  performance  ratings  models  were  used  to  estimate  performance  differences 
among  employees.  Since  little  variation  in  performance  ratings  exist,  the  results  may  not 
give  concrete  results  if  we  use  average  performance  ratings.  Therefore,  focusing  on  those 
who  receive  the  highest  performance  ratings  may  provide  substantially  better  results  in 
distinguishing  superior  performers  from  the  others.  Also,  better-performing  employees 
often  are  placed  in  supervisory  positions  as  a  reward.  Therefore,  a  model  of  the 
probability  of  being  a  supervisor  is  estimated  to  gauge  job  performance. 

1,  Salary  Models 

Numerous  studies  about  returns  to  investment  in  human  capital  have 
demonstrated  quite  clearly  that  more  educated  workers  earn  more  than  those  with  less 
education.  Based  on  the  assumption  that  salary  is  one  indicator  of  job  performance,  two 
different  salary  models  are  built  to  estimate  the  effect  of  graduate  education.  The  first 
model  estimates  the  average  percentage  salary  increase  of  employees  hired  in  1986  while 
they  were  in  the  federal  service.  This  model  can  be  estimated  by  ordinary  least  square 
regression  equations.  The  effects  of  education  and  other  explanatory  variables  on  salary 
are  measured  in  percentages  since  the  dependent  variable  is  already  measured  as  the 
percentage  increase  of  salary.  The  equation  for  this  model  can  be  written  as  follows: 

Y  =  po  +  PiX  +  8 

Where 

Y  =  real  average  percentage  salary  increase  between  1986  and  1999; 
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Po  =  constant  term; 

X  =  a  vector  of  explanatory  variables  that  explains  the  variation  InY ; 

Pi  =  a  vector  of  parameters  to  be  estimated  and; 

8  =  a  random  error  term. 

The  second  model  estimates  the  average  salary  of  employees  while  they  are  in  the 
federal  service.  The  average  salaries  are  also  measured  in  real  terms.  A  semi-log  model  is 
specified  to  estimate  the  effect  of  education  and  other  explanatory  variables  on  salary. 
The  equation  for  this  model  is: 

Ln(Y)=  po  +  piX  +  8 

Where 

Y  =  average  salary  of  employees  hired  ini  986  for  the  period  1986-1999 

Po  =  constant  term; 

X  =  a  vector  of  explanatory  variables  that  explains  the  variation  in  ln(Y); 

Pi  =  a  veetor  of  parameters  to  be  estimated  and; 

8  =  a  random  error  term. 

These  two  models  provide  a  broad  view  of  the  employees’  pereentage  salary 
increase  and  their  overall  average  salary.  With  the  results  of  these  two  models,  we  ean 
better  understand  the  overall  salary  ehanges  of  employees  while  they  are  working  in  the 
DoD  civilian  service,  and  the  effeet  of  graduate  degrees. 

The  data  is  restricted  to  employees  with  a  Baehelor’s  degree  or  higher  so  that  we 
can  compare  differences  among  similar  education  levels.  In  both  models,  the  same 
explanatory  variables  are  used.  The  explanatory  variables  consist  of  background 
variables,  education  variables,  regional  and  oecupational  variables.  Baekground  variables 
inelude  sex  and  raee  to  explain  the  differenees  between  minorities  and  women  in  the 
quality  of  schooling  or  in  the  types  of  college  majors.  An  edueation  level  variable  is  also 
added  to  the  model.  However,  the  edueation  variable  is  not  reeorded  eorrectly  in  every 
year  of  the  data;  therefore,  only  the  entry  education  level  is  used  as  an  indicator  of 
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education  [Ref: 8].  Also  a  variable  for  labor  market  experience  is  also  added  to  the  model 
with  the  expectation  that  a  more  experienced  worker  will  earn  more  as  a  federal  worker. 
As  indicated  in  Chapter  I,  earnings  differ  across  regions  to  compensate  for  different 
economic  conditions  and  for  differences  in  the  cost  of  living.  Therefore,  regional 
variables  were  also  added  to  the  models.  Since  there  are  many  different  jobs  in  the  DoD, 
general  occupational  variables  were  also  included  in  the  model  to  account  for  the  effects 
of  different  occupations  on  earnings.  Most  importantly,  the  salary  is  correlated  with  the 
grade  levels;  therefore,  the  grade  levels  were  also  included  in  both  models. 

Descriptive  statistics  are  shown  in  Table  12.  Since  the  same  variables  are  used  in 
both  models,  only  one  table  is  prepared  for  two  models. 

Table  12,  Variable  Definitions  and  Descriptive  Statistics  for  Salary  Models  For  1986 

New  Hires 


Variable 

Variable  Description 

Model  1 

Model  2 

Names 

% 

% 

Female 

l=Female 

34.76 

37.78 

0=Male 

65.24 

62.22 

Black 

l=Black 

10.00 

10.19 

0=Not  Black 

90.00 

89.81 

Hispanic 

l=Hispanic 

3.50 

3.58 

0=Not  Hispanic 

96.50 

96.42 

White 

1=  White 

75.98 

62.21 

0=Not  White 

24.02 

37.79 

Otherace 

l=Other  Race 

10.43 

9.57 

0=Not  other  race 

89.57 

90.43 

Veteran 

1=  Veteran 

6.88 

6.91 

0=Not  Veteran 

93.22 

93.09 

BA86 

l=Employee  with  a  Bachelor’s  degree 

85.23 

84.46 

0=Employee  with  no  Bachelor’  degree 

14.77 

15.54 

MA86 

l=Employee  with  a  Master’s  degree 

12.15 

12.94 

0=Employee  with  no  Master’s  degree 

87.75 

87.06 

PH86 

l=Employee  with  a  Doctorate’s  degree 

2.60 

2.58 

0=Employee  with  no  Doctorate’s  degree 

97.40 

97.42 

Supervisor 

l=Employee  is  a  supervisor  in  1986 

2.36 

2.81 
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0=Employee  is  not  a  supervisor  ini 986 

97.64 

97.19 

Profession 

l=Employee  is  in  a  professional  oecupation 

60.37 

56.71 

0=Employee  is  not  in  a  professional  oeeupation 

39.73 

43.29 

Administrative 

l=Employee  is  in  an  administrative  oeeupation 

22.64 

21.97 

0=Employee  is  not  in  an  administrative 

77.36 

78.03 

oecupation 

Teehnieal 

l=Employee  is  in  a  technical  occupation 

6.26 

7.71 

0=Employee  is  not  in  a  technical  position 

93.74 

92.29 

Clerk 

l=Employee  is  in  a  clerical  occupation 

10.11 

12.79 

0=Employee  is  in  a  clerical  occupation 

89.89 

87.21 

Otherwe 

l=Employee  is  in  other  white-collar  occupation 

0.61 

0.80 

0=Employee  is  in  other  white-collar  occupation 

99.39 

99.20 

Metropolitan 

l=Census  region  is  a  metropolitan 

82.47 

82.49 

0=Census  region  is  not  a  metropolitan 

11.53 

17.51 

Newengland 

l=Census  region  is  New  England 

3.40 

3.85 

0=Census  region  is  not  New  England 

96.60 

96.15 

Midatlantie 

l=Census  region  is  Mid- Atlantic 

9.63 

9.57 

0=Census  region  is  Mid- Atlantic 

90.37 

90.43 

Eastnortheent 

l=Census  region  is  East  North  Center 

10.66 

9.41 

0=Census  region  is  not  East  North  Center 

89.34 

90.59 

Westnorteent 

l=Census  region  is  West  North  Center 

4.12 

4.17 

0=Census  region  is  West  North  Center 

95.88 

95.83 

Southatlantie 

l=Census  region  is  South  Atlantic 

30.13 

31.36 

0=Census  region  is  not  South  Atlantic 

79.87 

78.64 

Eastsouthatlan 

l=Census  region  is  East  South  Atlantic 

4.70 

4.40 

0=Census  region  is  not  East  South  Atlantic 

95.30 

95.60 

Westsouthatlan 

l=Census  region  is  West  South  Atlantic 

13.70 

12.83 

0=Census  region  is  not  West  South  Atlantic 

86.30 

87.17 

Mountain 

l=Census  region  is  Mountain 

4.88 

4.80 

0=Census  region  is  not  Mountain 

95.22 

95.20 

Paeifie 

l=Census  region  is  Pacific 

18.74 

19.55 

0=Census  region  is  not  Pacific 

92.26 

90.45 

Continuous 

Variables 

Mean 

Pereentage 
Salary  Inerease 

Real  percentage  salary  increase  of  the  employees 
between  1986  and  1999 

41.11 
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Ln(Average 

Salary) 

Log  of  real  average  salary  of  employees 

10.12 

Average  salary 

Real  average  salary  of  employees  between  1986 
and  1999 

26472.29 

Priexp 

Prior  experience  in  years  before  joining  ml986 

7.74 

8.05 

Sqrpriexp 

Square  of  prior  experience 

127.4 

135.04 

Grade86 

Pay  grade  in  1986 

7.14 

7.08 

Ni=5675 

N2=7495 

2.  Promotion  Models 

Although  past  studies  used  earnings  to  measure  performanee,  some  authors 
indieated  some  weaknesses  in  this  method  and  tried  to  find  direct  measures  of  on-the-job 
productivity.  David  A.  Wise  (1975)  used  maximum  likelihood  techniques  to  estimate  a 
promotion  probability  to  analyze  the  relation  between  job  performance  and  education 
[Ref:2].  He  thought  the  worker’s  rate  of  upward  movement  through  the  grades  might  be  a 
more  direct  measure  of  job  performance  than  the  rate  of  salary  increase.  There  was  a 
problem  with  the  assumption  that  salary  is  a  valid  job  performance  measure.  First, 
salaries  are  given  to  positions  rather  than  to  individuals.  Therefore,  salary  is  not  totally  an 
indicator  of  employee’s  performance.  Second,  basic  salary  was  automatically  increased 
with  years  of  service  even  if  the  employee  was  not  promoted. 

Two  models  were  specified  in  this  thesis  to  estimate  the  effect  of  education  on  the 
promotion  probability  and  promotion  speed.  In  the  first  model,  a  classical  binary  logit 
model  is  used  to  estimate  the  effect  of  education  on  promotion  probability.  In  this  model, 
employees  hired  in  1986  are  tracked  until  1992  and  the  model  dependent  variable  is 
coded  as  0  or  1,  depending  on  the  employee’s  promotion  event.  If  an  employee  is 
promoted  at  least  once  before  1992,  the  dependent  variable  is  coded  1.  Otherwise  it  is 
coded  0.  Since  it  requires  time  to  promote  in  the  DoD  service,  the  promotion  probability 
model  analyzed  a  six-year  period  to  estimate  the  changes  in  promotion.  The  promotion 
probability  model  can  be  written  as: 

P  (promotion  0  =  Po  +  PX  +8 

Where 
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P  (promotion)  =  the  probability  of  promotion  for  employee  i, 

Po  =  eonstant  term, 

P  =  a  veetor  of  eoeflioients  for  the  X  variables,  and 

8  =  an  error  term. 

In  the  seeond  model,  the  speed  of  promotion  is  estimated  using  a  survival 
teehnique.  In  this  model,  the  times  to  first  and  seeond  promotion  are  estimated.  The  main 
advantages  of  this  model  are  that  it  eonsiders  the  eensored  data  due  to  early  separation, 
and  it  estimates  both  the  promotion  probability  and  the  length  of  time  required  to  be 
promoted  to  the  next  higher  grade.  The  data  were  reorganized  in  order  to  estimate  the 
time  to  first  and  seeond  promotion.  Sinee  the  dates  of  promotions  are  not  reeorded 
eorreetly  in  the  original  data,  ehange  in  grades  is  used  to  indieate  a  promotion  event  and 
the  speed  of  promotion.  The  data  is  traeked  in  two-year  intervals.  Therefore  the  time 
length  for  promotion  in  our  data  is  in  terms  of  years. 

In  survival  analysis,  the  time  until  an  event  oeeurs  is  assumed  to  be  the  realization 
of  a  random  proeess.  The  hazard  funetion  or  hazard  rate  is  used  to  deseribe  the 
probability  distribution  of  event  times.  The  hazard  funetion  is  defined  as  the  risk  of  the 
event  oeeurring  in  year  t+l,  given  that  it  did  not  oeeur  in  month  t.  Formally,  the  hazard 
funetion,  h(t),  is 

h(t)=f(t)/S(t) 

with  S(t)=Pr{T>}  and  f(t)=dS(t)/dt 

where  S(t)  is  the  eumulative  survival  funetion.  S(t)  gives  the  eumulative 
probability  that  event  time  T  is  greater  than  t.  For  example,  T  indieates  the  eumulative 
probability  that  an  individual  is  promoted  after  month  t,  and  f(t)  is  the  probability-density 
funetion.  The  hazard  funetion  is  used  to  deseribe  the  probability-distribution  funetion  in 
survival  analysis  beeause  it  ean  be  interpreted  as  the  probability  an  event  oeeurs  at  time  t 
given  it  did  not  oeeur  at  t-1 . 

In  the  Cox  proportional-hazard  model  with  time  varying  eovariates,  the  hazard 
function  is  given  by: 
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Lnpi(t)  =a(t)+piXi  +  p2Zi(t) 

where  pi(t)  is  the  hazard  of  promotion  for  individual  (i)  and  Xi  is  a  veetor  of  job 
and  individual  eharaeteristics  that  are  measured  at  entry  and  that  do  not  vary  with  time. 
These  eharaeteristics  include  race,  sex,  grades  at  promotion,  and  prior  work  experience  at 
entry.  Zi(t)  is  a  vector  of  individual  characteristics  that  vary  with  time,  such  as  the 
cumulative  number  of  years  for  which  he  or  she  received  each  rating  level(l  to  5). 

Table  13  displays  variable  names,  and  description  and  the  means  or  proportion  of 
variables  used  in  each  of  the  three  models.  The  second  and  third  columns  are  similar  in 
values  since  they  use  the  same  models  with  slightly  different  variables. 

Table  13.  Descriptive  Statistics  for  Promotion  Models 


Logit 

Model 

Survival 

Model  1 

Survival 

Model  2 

Dummy 

Variables 

Variable  Description 

% 

% 

% 

Female 

l=Female 

0=Male 

33.50 

65.24 

33.65 

66.35 

33.65 

66.35 

Black 

l=Black 

0=Not  Black 

10.00 

90.00 

9.96 

90.04 

9.96 

90.04 

Hispanic 

l=Hispanic 

0=Not  Hispanic 

3.40 

96.60 

3.39 

96.61 

3.39 

96.61 

White 

1=  White 

0=Not  White 

75.34 

24.66 

75.29 

24.71 

75.29 

24.71 

Otherace 

l=Other  Race 

0=Not  Other  Race 

10.43 

89.57 

11.35 

88.65 

11.35 

88.65 

Veteran 

1=  Veteran 

0=Not  Veteran 

92.19 

7.81 

92.29 

7.71 

92.29 

7.71 

BA86 

l=Employee  with  a  Bachelor’s  degree 
0=Employee  with  no  Bachelor’  degree 

85.08 

14.92 

85.27 

14.73 

85.27 

14.73 

MA86 

l=Employee  with  a  Master’s  degree 
0=Employee  with  no  Master’s  degree 

12.09 

87.91 

11.94 

88.06 

11.94 

88.06 

PH86 

l=Employee  with  a  Doctorate’s  degree 
0=Employee  with  no  Doctorate’s 
degree 

2.80 

97.20 

2.77 

97.23 

2.77 

97.23 

Supervisor 

l=Employee  is  a  supervisor  in  1986. 
0=Employee  is  not  a  supervisor  in  1986. 

2.77 

97.33 

2.70 

97.30 

2.70 

97.30 
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Ratingbest 

l=Average  rating  is  1  and  2  (outstanding) 
between  1986  and  1992. 

0=Average  rating  is  3,  4,  and  5(average 

and  bad)  between  1986  and  1992. 

50.02 

49.98 

Profession 

l=Employee  is  in  a  professional 
occupation. 

0=Employee  is  not  in  a  professional 
occupation. 

60.18 

39.82 

60.30 

39.70 

60.30 

39.70 

Admin 

l=Employee  is  in  an  administrative 
occupation. 

0=Employee  is  not  in  an  administrative 
occupation. 

22.96 

77.04 

22.82 

87.18 

22.82 

87.18 

Technical 

l=Employee  is  in  a  technical 
occupation. 

0=Employee  is  not  in  a  technical 
occupation. 

6.47 

93.53 

6.44 

93.47 

6.44 

93.47 

Clerk 

l=Employee  is  in  a  clerical 
occupation. 

0=Employee  is  not  in  a  clerical 
occupation. 

10.11 

89.89 

9.91 

90.09 

9.91 

90.09 

Otherwc 

l=Employee  is  in  other  white-collar 
occupation. 

0=Employee  is  not  in  other  white-collar 
occupation. 

0.61 

99.39 

0.50 

99.50 

0.50 

99.50 

Fleet 

l=Eunctional  area  is  fleet. 

0=Eunctional  area  is  not  fleet. 

7.45 

92.55 

7.46 

92.54 

7.46 

92.54 

Intel 

l=Eunctional  area  is  intelligence. 
0=Eunctional  area  is  not  intelligence. 

6.34 

93.76 

6.63 

93.37 

6.63 

93.37 

Material 

l=Eunctional  area  is  material. 

0=Eunctional  area  is  not  material. 

50.98 

49.02 

50.10 

49.90 

50.10 

49.90 

Trainning 

l=Eunctional  area  is  training. 

0=Eunctional  area  is  not  training. 

3.58 

96.42 

3.54 

96.46 

3.54 

96.46 

Medical 

l=Eunctional  area  is  medical. 

0=Eunctional  area  is  not  medical. 

3.09 

96.91 

3.04 

96.97 

3.04 

96.97 

Headqrt 

l=Eunctional  area  is  department 
headquaters. 

0=Eunctional  area  is  not  department 
headquaters. 

2.86 

97.14 

2.86 

97.14 

2.86 

97.14 

Adminact 

l=Eunctional  area  is  administrative 

34.60 

22.82 

22.82 
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aetivities. 

0=Funetional  area  is  not  administrative 

aetivities. 

65.40 

87.18 

87.18 

Grade 1 

l=Pay  grades  are  between  1  and  5  in  1986 
0=Pay  grades  are  not  between  1  and  5  in 
in  1986. 

27.50 

72.50 

Grade2 

l=Pay  grades  are  between  5  and  9  in  1986. 
0=Pay  grades  are  not  between  5  and  9  in 
1986. 

70.65 

29.35 

Grades 

l=Pay  grades  are  between  10  and  13  in 
in  1986. 

0=Pay  grades  are  not  between  10  and 

13  in  1986. 

1.13 

98.87 

Graded 

l=Pay  grades  are  between  14  and  15  in 

1986 

0=Pay  grades  are  not  between  14  and 

15  in  1986. 

0.20 

99.80 

Promote92 

l=Promoted  at  least  onee  before  1992 

0=Not  promoted 

87.91 

12.09 

Promote 

l=The  pereent  of  l'^*  promotion  between 

1986  and  1999 

0=Censored  due  to  early  dropout 

96.49 

3.51 

2"‘*  Promote 

l=The  pereent  of  2"*^  promotions 
between  1986  and  1999 

0=Censored  due  to  early  dropout 

94.03 

5.97 

Cumratl 

The  ratio  of  getting  l(exeellent)  over  total 
ratings 

18.88 

23.00 

Cumrat2 

The  ratio  of  getting  2(good)  over  total 
ratings 

36.21 

38.06 

Continuous 

Variables 

Mean 

Timel 

Average  time  to  first  promotion  (in  years) 

2.92 

Time2 

Average  time  from  first  to  seeond 
promotion  (in  years) 

3.29 

Grade 1 

Average  grade  at  first  promotion 

8.62 

Grade2 

Average  grade  at  seeond  promotion 

9.10 

Priexp 

Prior  experienee  in  years  before  joining  in 

8.17 

8.08 

8.08 

Sample  Size 

(N=4498) 

(N=4570) 

(N=4570) 
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3,  Retention  Models 


Previous  analyses  have  shown  that  the  effect  of  personnel  quality  and  education 
on  retention  is  ambiguous  and  cannot  be  predicted  a  priori.  That  is,  theory  cannot  predict 
whether  higher  educated  personnel  are  more  likely  to  stay  in  the  civil  service  or  less 
likely  [Ref:  12],  The  reason  is  that  higher-quality  personnel  have  better  opportunities 
than  lower-quality  personnel,  both  inside  and  outside  the  civil  service.  Whether  higher 
quality  personnel  are  more  likely  to  stay  or  to  leave  depends  on  the  incentives  inside  or 
outside  the  service.  On  the  other  hand,  employers  want  to  keep  qualified  and  experienced 
employees  in  their  workforce.  This  is  true  because  qualified  and  educated  workers  are 
helpful  in  increasing  job  productivity  and  decreasing  the  manpower  costs. 

Some  studies  suggested  that  the  turnover  rate  in  the  federal  service  is  lower 
compared  to  the  civilian  sector.  In  1987  Richard  A.  Ippolito  conducted  a  study  analyzing 
quit  rates  in  the  federal  government  [Ref:  13].  In  his  study  he  suggested  that  the  federal 
pension  system  imposed  large  penalties  on  workers  who  quit  early  because  the  portion  of 
pay  in  the  form  of  pensions  was  much  higher  for  federal  workers  than  comparable  non- 
federal  workers.  As  a  result,  the  quit  rate  was  lower  for  federal  employees. 

Two  retention  models  were  specified  to  analyze  the  effect  of  graduate  education 
on  retention  of  DoD  civilian  employees  with  the  expectation  that  employees  will  act  as 
utility  maximizers.  This  theory  supports  the  idea  that  employees  would  prefer  to  stay  in 
the  civilian  service  if  the  value  of  continued  federal  service  exceeds  the  value  of  a  job  in 
the  private  sector. 

The  variables  that  are  assumed  to  affect  retention  are  mainly  personal  and  job 
characteristics.  Consequently,  the  model  includes  variables  related  to  personal 
characteristics  such  as  sex,  race,  age,  and  veteran  status.  Education,  veteran  status  and 
performance  rating  are  included  in  the  model.  Other  variables  are  added  to  the  model  to 
control  for  functional  areas  and  regional  location. 

The  first  retention  model  is  estimated  using  a  binary  logit  technique  for 
employees  hired  in  1986.  In  this  model,  employees  are  followed  until  1992  to  see 
whether  they  are  still  in  the  service  or  not.  If  they  are  still  in  the  service,  the  dependent 
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variable  is  coded  1.  Otherwise  it  is  coded  0.  The  basic  binary  logit  model  can  be  written 
simply  as  follows: 

P  (retention)  =  Po  +  PX  +8 

Where 

P  (retention)  =  the  probability  of  staying  for  employee  i, 

Po  =  constant  term, 

P  =  a  vector  of  coefficients  for  the  X  variables,  and 

8  =  an  error  term. 

The  second  retention  model  is  a  survival  model  based  on  a  Cox  regression.  In  this 
model,  the  time  to  separation  is  estimated.  The  data  sample  contains  employees  hired  in 
1986.  These  employees  are  tracked  up  to  1999,  the  end  of  the  data.  During  this  14  year- 
period,  snapshots  of  employees  were  taken  every  two  years,  except  for  the  last  year, 
1999.  Since  Cox  regression  also  takes  into  account  the  censored  elements,  employees 
who  are  not  separated  at  the  end  of  the  data  are  used  to  indicate  censored  data.  The 
dependent  variable  is  characterized  by  the  time  to  separation  in  years.  The  explanatory 
variables  consist  of  personal  characteristics  such  as  sex,  race,  education,  occupation 
variables,  supervisory  position  and  veteran  status,  are  added  to  the  model.  The  Cox 
regression  model  can  be  written  in  equation  as  follows: 

lnS,(t)  =a(t)+piX,  +p2Z,(t) 

where  Si(t)  is  the  hazard  of  separation  for  individual  (i)  and  Xi  is  a  vector  of  job 
and  individual  characteristics  that  are  measured  at  entry  and  that  do  not  vary  with  time. 
These  characteristics  include  race,  sex,  and  prior  work  experience  at  entry.  Zi(t)  is  a 
vector  of  individual  characteristics  that  vary  with  time,  such  as  the  cumulative  number  of 
years  for  which  he  or  she  received  each  rating  level  (1  to  5)  until  separating  or  the  data 
ends.  Table  14  presents  descriptive  statistics  of  the  variables  used  for  the  retention  logit 
and  the  survival  model. 
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Table  14.  Descriptive  Statistics  for  Retention  Models 


Logit 

Model 

Survival 

Model 

Dummy 

Variables 

Variable  Description 

% 

% 

Female 

l=Female 

36.34 

40.00 

0=Male 

63.66 

60.00 

Blaek 

l=Black 

10.26 

10.64 

0=Not  Black 

89.74 

89.36 

Hispanic 

l=Hispanic 

3.72 

3.84 

0=Not  Hispanic 

96.28 

9.97 

White 

1=  White 

75.86 

75.55 

0=Not  White 

24.14 

24.45 

Otherace 

l=Other  Race 

10.15 

9.97 

0=Not  Other  Race 

89.85 

80.03 

Veteran 

1=  Veteran 

7.26 

7.26 

0=Not  Veteran 

92.74 

92.74 

BA86 

l=Employee  with  a  Bachelor’s  degree 

84.47 

84.50 

0=Emplovee  with  no  Bachelor’  degree 

15.53 

15.50 

MA86 

l=Employee  with  a  Master’s  degree 

12.74 

12.82 

0=Employee  with  no  Master’s  degree 

87.26 

87.18 

PH86 

l=Employee  with  a  Doctorate’s  degree 

2.78 

2.67 

0=Employee  with  no  Doctorate’s  degree 

97.22 

97.33 

Supervisor 

l=Employee  is  a  supervisor. 

2.81 

3.17 

0=Employee  is  not  a  supervisor. 

97.29 

96.83 

Profession 

l=Employee  is  in  a  professional  occupation. 

59.23 

57.08 

0=Employee  is  not  in  a  professional 
occupation. 

41.77 

42.92 

Admin 

l=Employee  is  in  an  administrative  occupation. 

21.92 

21.39 

0=Employee  is  not  in  an  administrative 
occupation. 

88.08 

88.61 

Technical 

l=Employee  is  in  a  technical  occupation 

7.30 

8.66 

0=Employee  is  not  in  a  technical  position 

92.70 

91.34 

Clerk 

l=Employee  is  in  a  clerical  occupation 

10.86 

12.13 

0=Employee  is  not  in  a  clerical  occupation 

89.14 

87.87 

Otherwc 

l=Employee  is  in  other  white-collar  occupation. 
0=Employee  is  not  in  other  white-collar 

0.60 

0.70 

occupation. 

99.40 

99.30 

Fleet 

l=Eunctional  area  is  fleet. 

6.97 

11.88 
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0=Functional  area  is  not  fleet. 

93.03 

88.12 

Intel 

l=Functional  area  is  intelligence. 

0=Functional  area  is  not  intelligence. 

5.97 

94.03 

5.82 

94.18 

Material 

l=Functional  area  is  material. 

0=Functional  area  is  not  material. 

47.61 

53.39 

44.23 

55.77 

Trainning 

l=Functional  area  is  training. 

0=Functional  area  is  not  training. 

4.56 

95.44 

4.39 

95.61 

Medical 

l=Functional  area  is  medical. 

0=Functional  area  is  not  medical. 

5.94 

94.06 

5.50 

94.50 

Headqrt 

l=Functional  area  is  department  headquarters. 
0=Functional  area  is  not  department 
headquarters. 

3.06 

96.94 

2.94 

97.06 

Adminact 

l=Functional  area  is  administrative  activities. 

0=Functional  area  is  not  administrative 

activities. 

25.87 

74.13 

25.19 

74.81 

Retent92 

l=Still  in  the  servce  in  1992 

0=Left  the  service  before  1992 

71.18 

28.82 

Sepevent 

l=Separated  from  the  service  before  1999 
0=Censored  due  to  the  end  of  data 

50.8 

49.02 

Cumratl 

The  ratio  of  getting  1  (Outstanding)  over  total 
ratings 

21.86 

Cumrat2 

The  ratio  of  getting  2(good)  over  total  ratings 

27.32 

Continuous 

Variables 

Mean 

Ratingtop 

l=Average  rating  is  below  3  (the  best)  between 
1986  and  1999. 

0=Average  rating  is  3,  4,  and  5  (average  and 
bad)  between  1986  and  1999. 

1.29 

Time 

Average  time  of  staying  in  the  service 

9.905 

Age86 

Employees’  age  at  entry  in  1986 

30.50 

30.51 

Sample  Size 

N=6177 

N=6800 

4,  Performance  Rating  Model 

Performance  ratings  are  done  every  year  in  the  DoD  civilian  service.  The  ratings 
are  a  report  of  the  job  performance  of  the  employee  for  the  year.  But  the  ratings  might  not 
reflect  the  true  performance  of  the  employee’s  performance  due  to  the  subjectivity  of  the 
evaluations.  According  to  Muchinsky,  [Ref:  14]  there  are  three  common  weaknesses  of 
supervisor  or  manager  evaluations  of  their  employees.  First,  since  employees  are 
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evaluated  by  many  managers,  varying  ratings  may  be  observed  even  for  the  same  job 
performance.  Some  managers  or  supervisors  are  very  strict  raters  while  others  are  lenient 
raters.  Therefore,  ratings  might  be  overestimated  or  underestimated  due  to  the 
subjectivity  of  managers. 

Second,  the  employee’s  characteristics  may  influence  the  raters.  The  employee 
might  have  a  good  rapport  with  the  manager  due  to  the  personal  characteristics  of  the 
employee  or  vice  versa.  This  relationship  then  affects  the  perceptions  of  the  manager 
about  the  employee’s  job  performance.  As  a  result,  the  rater  may  tend  to  evaluate  the 
employee  very  good  or  very  bad  according  to  his  one-sided  perception  of  an  employee. 

Third,  some  managers  tend  to  avoid  trouble  by  not  giving  high  or  low  grades.  In 
this  case,  managers  do  not  want  any  trouble  ensuing  from  the  evaluations.  The  rater  may 
give  middle  level  ratings  to  keep  themselves  in  a  safe  position. 

Despite  all  these  weaknesses,  performance  ratings  are  important  indicators  of  an 
employee’s  performance.  Employees  are  classified  or  at  least  promoted  according  to  the 
results  of  these  ratings.  Therefore,  I  have  built  two  models  to  see  the  effect  of  personal 
and  job  characteristics  on  ratings.  The  first  model  analyzes  the  percentage  of  “excellent” 
ratings.  The  regression  model  is  used  to  estimate  the  effect  of  graduate  education  and 
other  personal  characteristics  on  the  ratio  of  cumulative  rating  1  (Outstanding)  over  total 
ratings  as  a  dependent  variable  for  the  six-year  period.  The  model  can  be  written  as 
follows: 

Y  =  po+PiX  +8 

Where 

Y  =  the  ratio  of  getting  1  (outstanding)  over  total  ratings  until  1996  for  employee  i, 

Po  =  constant  term. 

Pi  =  a  vector  of  coefficients  for  the  X  variables, 

X  =  the  variables  that  have  effect  on  performance  rating,  and 

8  =  an  error  term. 
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The  second  model  is  built  to  differentiate  whether  employees  hired  in  1986 
reached  supervisor  status.  To  be  selected  as  a  supervisor,  employees  must  prove  their 
ability  and  skill  at  their  jobs.  Therefore,  being  a  supervisor  can  be  an  indicator  of  job 
performance.  The  binary  logit  model  is  used  to  see  the  effect  of  graduate  education  on 
being  selected  for  a  supervision  job.  Employees  hired  in  1986  are  tracked  until  1992.  If 
the  employee  is  selected  to  be  a  supervisor  during  this  period,  then  the  dependent  variable 
is  coded  1;  otherwise  it  is  coded  0.  The  model  can  be  described  as  follows: 

P  (Supervisor  0  =  Po+  PiX  +8 

Where 

P  (Supervisor)  =  the  probability  of  being  a  supervisor  for  employee  i, 

Po  =  constant  term. 

Pi  =  a  vector  of  coefficients  for  the  X  variables, 

X  =  the  variables  that  affects  being  a  supervisor,  and 
8  =  an  error  term. 

Descriptive  statistics  for  the  variables  used  in  the  rating  models  are  displayed  in 
Table  15. 

Table  15.  Descriptive  Statistics  of  Performance  Ratings  Model 


Regression 

Model 

Logit 

Model 

Explanatory 

Variables 

Variable  Description 

% 

% 

Female 

l=Female 

41.50 

32.99 

0=Male 

58.50 

67.01 

Black 

1=  Black 

10.57 

10.80 

0=Not  Black 

89.43 

89.20 

Hispanic 

l=Hispanic 

3.80 

3.46 

0=Not  HisDanic 

96.20 

9.54 

White* 

1=  White 

76.23 

74.10 

0=Not  White 

23.77 

25.90 

Otherace 

l=Other  Race 

9.38 

11.61 

0=Not  Other  Race 

90.62 

88.39 

Veteran 

1=  Veteran 

7.10 

7.23 

0=Not  Veteran 

92.90 

92.77 
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BA86* 

l=Employee  with  a  Baehelor’s  degree 
0=Emplovee  with  no  Baehelor’  degree 

83.93 

16.07 

84.10 

15.90 

MA86 

l=Employee  with  a  Master’s  degree 

13.46 

12.62 

0=Emplovee  with  no  Master’s  degree 

86.54 

87.38 

PH86 

l=Employee  with  a  Doetorate’s  degree 

2.59 

3.26 

0=Emolovee  with  no  Doetorate’s  degree 

97.41 

96.74 

Supervisor 

l=Employee  is  a  supervisor. 

0=Emplovee  is  not  a  supervisor. 

3.26 

96.84 

Profession* 

1=  Employee  is  in  a  professional  oeeupation. 

53.92 

57.08 

0=  Employee  is  not  in  a  professional 
oeeupation. 

46.08 

42.92 

Admin 

l=Employee  is  in  an  administrative 

21.72 

21.39 

oeeupation. 

0=Employee  is  not  in  an  administrative 
oeeupation. 

88.28 

88.61 

Teehnieal 

l=Employee  is  in  a  teehnieal  oeeupation. 

9.29 

8.66 

0=Emolovee  is  not  in  a  teehnieal  position. 

90.71 

91.34 

Clerk 

l=Employee  is  in  a  elerieal  oeeupation 

14.30 

12.13 

0=Emolovee  is  not  in  a  elerieal  oeeupation 

85.70 

87.87 

Otherwe 

l=Employee  is  in  other  white-eollar 
oeeupation. 

0.75 

0.70 

0=Employee  is  not  in  other  white-eollar 
oeeupation. 

99.25 

99.30 

Fleet 

l=Eunotional  area  is  fleet. 

13.05 

11.88 

0=Eunetional  area  is  not  fleet. 

86.95 

88.12 

Intel 

l=Eunetional  area  is  intelligenee. 

5.64 

5.82 

0=Eunetional  area  is  not  intelligenee. 

94.36 

94.18 

Material* 

l=Eunetional  area  is  material. 

41.96 

44.23 

0=Eunetional  area  is  not  material. 

58.04 

55.77 

Trainning 

l=Eunetional  area  is  training. 

4.09 

4.39 

0=Eunetional  area  is  not  training. 

95.91 

95.61 

Medieal 

l=Eunotional  area  is  medieal. 

5.72 

5.50 

0=Eunetional  area  is  not  medieal. 

94.28 

94.50 

Headqrt 

l=Eunetional  area  is  department  headquarters. 

3.21 

2.94 

0=Eunetional  area  is  not  department 
headquarters. 

96.89 

97.06 

Adminaet 

l=Eunetional  area  is  administrative  aetivities. 
0=Eunetional  area  is  not  administrative 

26.29 

25.19 

aetivities. 

73.71 

74.81 

Cumrat** 

The  ratio  of  getting  1  (Outstanding)  over  total 
ratings  between  1986  and  1994 

13.93 

21.86 

Sample  Size 

N=7811 

N=2970 

*Base  variables 


**  Dependent  variable 
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IV.  RESULTS  OF  PERFORMANCE  MODELS 


This  chapter  presents  the  results  of  four  different  performanee  models:  salary, 
promotion,  retention,  and  performanee  ratings  presented  in  Chapter  III.  Eaeh  model 
explains  separately  the  statistieal  signifieance  of  the  explanatory  variables,  the  effects  of 
these  variables  on  the  performance  measures,  and  the  signifieance  of  the  overall  model. 

A.  RESULTS  OF  SALARY  MODELS 

Two  salary  measures  were  used  to  estimate  the  effect  of  graduate  education  on  the 
earnings  of  the  DoD  civilian  employees.  The  first  model  examines  the  average 
percentage  salary  increases  of  employees  hired  in  1986  and  who  remained  employed  in 
the  federal  service  until  1999.  In  this  model  those  who  are  miscoded  in  the  salary 
pereentage  inerease  are  deleted  leaving  5,675  observations.  The  first  model  is  estimated 
by  ordinary  least  squares  techniques.  The  effects  of  education  and  other  explanatory 
variables  on  salary  are  measured  in  pereentages  since  the  dependent  variable  is  already 
measured  as  the  percentage  increase  of  salary.  The  results  of  the  salary  change  model  are 
shown  in  Table  16. 

The  second  model  estimates  the  effect  of  education  on  the  average  salary  of 
employees  while  employed  in  the  federal  serviee.  Average  salaries  are  also  measured  in 
real  terms.  A  semi-log  salary  model  is  speeified  to  estimate  the  effect  of  education  and 
other  explanatory  variables  on  average  salary.  Employees  who  were  hired  in  1986  are 
used  in  the  model  providing  7,495.  The  interpretation  of  the  eoefficients  of  the 
independent  variables  is  easy  to  understand  since  a  one-unit  ehange  in  the  explanatory 
variables  will  affect  the  dependent  variable  in  percentage  terms.  Specifieally,  a  one-unit 
change  will  affect  the  dependent  variable  by  P  *100  (P  is  the  coeffieient  of  an 
explanatory  variable).  Table  17  shows  the  results  of  the  average  salary  model.  Both 
models  were  run  in  two  steps.  In  the  first  step,  the  models  were  estimated  without  entry 
grade  level  controls.  In  the  second  step,  entry  grade  controls  were  added. 

The  overall  signifieance  of  both  models  ean  be  explained  by  the  R^,  whieh  is  a 
summary  measure  that  indieates  how  well  the  sample  regression  line  fits  the  data. 
Specifically,  R  measures  the  proportion  of  the  total  variation  in  Y  (dependent  variable) 
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explained  by  the  independent  variables  [Ref:  15].  In  eolumn  1  of  Table  16,  is  0.1457, 
whieh  means  14.57  percent  of  the  variation  in  the  average  salary  percentage  increase  is 
explained  by  the  variation  in  the  explanatory  variables.  In  the  third  column,  R  is  0.3323. 
In  Table  16,  R^’s  are  0.4897  in  the  first  column  and  0.6216  in  the  third  column. 


Table  16.  Model  of  Average  Percentage  Salary  Increase,  1986-1999 

Without  Grades  Control  With  Grades  Control 


Independent 

Variables 

Parameter 

Estimates 

Standard 

Error 

Parameter 

Estimates 

Standard 

Error 

Intercept 

44.3492* 

1. 1917 

94.5017* 

1.6442 

Female 

-0.0737 

0.8002 

-I.387I** 

0.7082 

Black 

-0.4552 

1.2072 

-3.4827* 

I.070I 

Hispanic 

-3.3933** 

1.9235 

-4.3944* 

1.7009 

Otherace 

-0.6294 

1.2093 

-1.8292** 

1.0696 

Veteran 

-1.8844 

1.5832 

2.0596 

1.4033 

MA86 

-8.4949* 

I. 1092 

0.7943 

1.0082 

PH86 

-14.7923* 

2.2577 

6.6445* 

2.0678 

Supervisor 

-15.5577* 

2.3531 

2.9III 

2.I3I8 

Technical 

2.0010 

I.5I29 

-10.9072* 

1.3765 

Administrative 

12.5801* 

0.9093 

4.9774* 

I.4I04 

Clerk 

6.3503* 

1.2866 

-11.3805* 

1.6427 

Otherwc 

21.6072* 

4.4792 

-22.2878* 

4.1409 

Metropolitan 

1.4017 

0.9613 

1. 1180 

0.8500 

Newengland 

-0.7271 

2.0917 

-0.6870 

1.7792 

Midatlantic 

3.1911  ** 

1.2980 

0.3960 

1. 1498 

Eastnorthcent 

5.7885* 

1.2894 

4.6072* 

1. 1405 

Westnortcent 

-2.4403 

1.8369 

-5.0399* 

1.6254 

Pacific 

0.6312 

1.0682 

-2.7680* 

0.9484 

Eastsouthatlan 

-1.4084 

1.7399 

-1.5655 

1.5384 

Westsouthatlan 

2.6834* 

1.2670 

-2.2590** 

1.0253 

Mountain 

3.3147* 

1. 1488 

0.7632* 

1.5240 

Priexp 

-1.1439* 

0.1294 

0.I8II 

0.II92 

Sqrpriexp 

0.0106** 

0.0043 

-0.0139** 

0.0003 

Grade86 

N.I. 

N.I. 

-7.II88* 

0.I79I 

R^ 

0.1457 

0.3323 

Mean 

41.11% 

41.11% 

E  Value 

41.91* 

II7.I5 

Sample  size 

5675 

5675 

*Significant  at  the  1  %  level  **  Significant  at  the  5%  level 


N.I.  =  not  included 
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Table  17,  Average  Salary  Model,  1986  1999 

Dep.  Variable=ln  (Av  Sal) 

Without  Grades  Control  With  Grades  Control 


Independent 

Variables 

Parameter 

Estimates 

Standard 

Error 

Parameter 

Estimates 

Standard 

Error 

Intercept 

10.2746* 

0.0968 

10.2727* 

0.0087 

Female 

-0.0910* 

0.0063 

-0.0686* 

0.0055 

Black 

-0.0245** 

0.0096 

-0.0045 

0.0084 

Hispanic 

-0.0102 

0.0153 

-0.0118 

0.0132 

Otherace 

0.0504* 

0.0101 

0.0592* 

0.0087 

Veteran 

0.0629* 

0.0127 

0.0187** 

0.0110 

MA86 

0.0272* 

0.0087 

-0.0394* 

0.0077 

PH86 

0.1852* 

0.0183 

-0.0486* 

0.0168 

Supervisor 

0.2214* 

0.0174 

-0.0200 

0.0171 

Technical 

-0.3975* 

0.0111 

-0.2505* 

0.0103 

Administrative 

0.1808* 

0.0074 

-0.1170* 

0.0067 

Clerk 

-0.5925* 

0.0094 

-0.2595* 

0.0131 

Otherwc 

-0.5185* 

0.0318 

-0.2397* 

0.0287 

Metropolitan 

0.0115 

0.0077 

0.0031 

0.0066 

Newengland 

-0.0265* 

0.0153 

-0.0188 

0.0132 

Midatlantic 

0.0332* 

0.0104 

-0.0025 

0.0090 

Eastnorthcent 

0.0566* 

0.0107 

0.0659* 

0.0093 

Westnortcent 

-0.1182* 

0.0144 

-0.0800* 

0.0127 

Pacific 

-0.0710* 

0.0084 

-0.0300* 

0.0073 

Eastsouthatlan 

0.0091* 

0.0094 

0.0032 

0.0120 

Westsouthatlan 

0.0372* 

0.0103 

0.0179** 

0.0082 

Mountain 

-0.0260* 

0.0145 

0.0148 

0.0124 

Priexp 

0.0067* 

0.0010 

-0.0037* 

0.0009 

Sqrpriexp 

-0.0001* 

0.0000 

0.0000 

0.0000 

Grade86 

N.I 

N.I 

Yes 

Yes 

0.4897 

0.6216 

Mean 

10.12 

10.12 

E  Value 

311.65* 

331.12* 

Sample  size 

7495 

7495 

*  Signifioant  at  one  percent  and  lower 


**  Significant  at  five  percent  level 
N.I  =  not  included 
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In  the  first  column  of  Table  16,  most  of  the  variables  have  the  expected  effectson 
the  dependent  variable.  However,  some  variables  like  Veteran,  MA86,  PH86,  and 
Supervisor  have  unexpected  negative  effects  on  salary  growth  rate.  These  variables  were 
expected  to  have  a  positive  impact  on  earnings  as  suggested  by  past  studies  and  human 
capital  theory.  Employees  with  a  Master’s  degree  received  an  8.49  %  lower  salary  growth 
compared  to  employees  with  a  Bachelor’s  degree.  Similarly,  employees  with  a  Doctorate 
had  a  14.79%  lower  salary  growth.  Employees  with  an  additional  year  of  prior  experience 
had  a  1.14  %  lower  salary  growth.  Employees  in  supervisor  positions  at  entrance  also 
received  a  15.55%  lower  salary  increase. 

In  column  3  of  Table  16,  when  entry  grades  were  included  in  the  model,  many 
variables  are  significant;  the  exceptions  are  Veteran,  MA86,  Metrop86,  Priexp, 
Newengland,  Westnortcent,  Southatlantic,  Eastsouthatlan,  and  Technical.  The  signs  of 
the  unexpected  effects  of  the  first  model  turned  out  to  be  consistent  with  past  studies, 
even  though  some  of  these  variables  are  not  significant  in  the  second  step.  Eor  example, 
employees  with  a  Master’s  or  Doctorate  have  0.79%  and  a  6.64%  higher  salary  growth 
within  the  same  grades.  Eemale  employees  have  a  lower  salary  growth  rate  than  males. 
Black,  Hispanic,  and  other  race  employees  experience  a  3.48%  4.39%,  and  1.82%, 
respectively,  lower  growth  rate  than  white  employees.  The  variable  Grade86  also  has  a 
negative  effect  on  the  employees’  salary  growth.  Employees  with  one  higher  grade  earn  a 
7.11%  lower  salary  growth.  This  shows  that  employees  with  a  Master’s  or  a  Doctorate 
are  entering  the  DoD  service  at  higher  grades.  Employees  with  a  Master’s  or  Doctorate 
receive  lower  salary  increases  when  compared  to  employees  with  a  Bachelor’s.  However, 
when  entry  grades  are  included  in  the  model,  salary  increases  of  employees  with  a  Master 
or  Doctorate  is  higher  than  employees  with  a  Bachelor’s.  This  result  clearly  demonstrates 
that  the  salary  increases  of  all  employees  who  enter  at  higher  grades  are  lower. 

Column  1  of  Table  17  shows  the  parameters  of  the  explanatory  variables  in  the 

average  salary  model  when  entry  grades  are  not  included  in  the  model.  All  the 

explanatory  variables  are  significant,  except  for  Metropolitan  and  Hispanic.  The  average 

salaries  of  employees  with  a  M.A  or  Ph.D  are  2.72%  and  18.52%,  respectively,  higher 

than  employees  with  a  Bachelor’s.  Employees  in  supervisor  position  also  earn  22.14% 

more.  Similarly,  veterans  and  employees  with  an  additional  year  of  prior  experience, 
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respectively,  earn  6.29%  and  0.67  more.  Employees  in  “administrative”  jobs  earn  18.08% 
more  than  employees  in  “professional”  jobs,  while  employees  in  “technical”  jobs, 
“clerical”  jobs  and  “other  white  collar”  jobs  earn  39.75%,  59.25%,  and  51.85%  more, 
respectively.  Employees  in  the  Pacific  region  earn  7.10%  less  than  employees  in  the 
South  Atlantic  census  region,  while  employees  in  the  East  North  Central  Region  census 
region  earn  5.66%  more  than  employees  in  the  South  Atlantic  census  region. 

In  column  3  of  Table  17,  when  entry  grades  are  included  in  the  model,  the  effect 
of  a  M.A  or  Ph.D  became  negative.  This  result  is  very  surprising  because  the  effect  of  a 
postgraduate  degree  was  expected  to  have  a  positive  impact  on  salary.  This  may  be 
because  employees  with  a  Master’s  or  Doctorate  remain  in  the  service  for  shorter  periods; 
therefore,  the  real  average  salaries  are  lower.  As  explained  earlier,  the  model  used  the 
employees  who  were  hired  in  1986  and  did  not  eliminate  those  who  leave  early. 

B,  RESULTS  OF  PROMOTION  MODELS 

Two  different  models  were  specified  to  estimate  the  effect  of  education  on  the 
promotion  probability  and  promotion  speed.  In  the  first  model,  a  classical  binary  logit 
model  estimates  the  promotion  probability.  In  the  second  model,  the  speed  of  promotion 
is  estimated  using  a  survival  technique.  One  survival  model  estimates  the  time  to  first 
promotion  and  a  second  estimates  the  time  to  second  promotion. 

The  “goodness  of  fit”  of  the  logit  model  and  survival  models  can  be  examined  by 
their  -2  log  L  value.  This  value  is  distributed  Chi-Square,  and  tests  the  null  hypothesis 
that  all  coefficients  are  not  different  from  zero.  The  -2  log  L  value  of  the  logit  model  is 
3317.71  (p<.0001).  Similarly  the  -2  Log  L  values  of  the  first  and  second  promotion  time 
survival  models  are  69939.215  and  67368.248,  respectively  (p<.0001  for  both  survival 
models).  Another  fit  statistic  for  the  logit  model  is  the  Classification  Table,  which 
provides  the  number  of  events  and  non-events  in  the  model.  The  term  “event”  in  the  logit 
promotion  model  means  that  an  observation  that  is  predicted  to  be  promoted  actually  gets 
promoted.  Similarly,  a  “non-event”  is  an  observation  that  is  predicted  not  to  be  promoted 
and  is  in  fact  not  promoted.  The  Classification  Table  shows  88.2%  correctly  predicted 
events  and  non-events.  Therefore,  both  logit  model  and  survival  models  are  significant  at 
all  levels. 
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Table  18.  Results  of  Logit  Promotion  Model 


Independent 

Variables 

Parameter 

Estimates 

Standard 

Error 

Partial 

Effects 

Intereept 

2.6889* 

0.1204 

Eemale 

-0.0621 

0.1170 

-0.0050 

Black 

0.0344 

0.1813 

0.0030 

Hispanic 

-0.1137 

0.2711 

-0.0105 

Otherace 

-0.0325 

0.1527 

-0.0020 

Veteran 

-0.0951 

0.1658 

-0.0087 

MA86 

-0.2363** 

0.1346 

-0.0229 

PH86 

-0.9041* 

0.2231 

-0.1134 

Supervisor 

-0.4295 

0.2363 

-0.0490 

Priexp 

-0.0572 

0.0059 

-0.0052 

Ratingbest 

0.0867 

0.1026 

0.0074 

Admin 

-0.0220 

0.1356 

-0.0020 

Teehnical 

-0.0991 

0.1867 

-0.0091 

Clerk 

0.1233 

0.1812 

0.0104 

Otherwe 

0.4974 

0.7811 

0.0357 

Eleet 

-0.9305* 

0.1597 

-0.1179 

Intel 

0.4974* 

0.2724 

0.0360 

Training 

-0.3987* 

0.2156 

-0.0413 

Medieal 

-0.7017* 

0.2221 

-0.0816 

Headqrt 

-0.7135* 

0.2430 

-0.0830 

Adminact 

0.2214 

0.1362 

0.0179 

Grade 1 

0.5616* 

0.1463 

0.0396 

Grades 

-0.6403** 

0.3274 

-0.0728 

Graded 

-14.9957 

321.5 

-0.9021 

Sample  Size 

4498 

-2EogE  3317.15* 

*  Significant  at  the  1%  level 
**  Significant  at  the  5%  level 


In  the  logit  model,  3,954  employees  are  promoted  out  of  4,498  total  employees 
(87.9%).  Employees  who  left  before  1992  are  not  ineluded  in  the  model.  The  logit  model 
indicates  that  not  much  variation  is  observed  on  the  effects  of  explanatory  variables  on 
the  dependent  variable  since  nearly  all  employees  are  promoted.  However,  the  results 

show  signifieant  effects  of  graduate  education.  Employees  with  a  Master’s  or  Doctorate 
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are  2.29%  and  11.34%,  respectively,  less  likely  to  be  promoted  than  employees  with  a 
Bachelor’s  in  Table  18.  Employees  in  grade  group  1  (Grades  1  to  5)  are  7.28%  more 
likely  to  be  promoted  than  employees  in  grade  group  2  (Grades  6  to  9).  As  expected, 
employees  in  grade  group  3  (grades  10  to  13)  and  grade  group  4  (grades  14  to  15)  are  less 
likely  to  be  promoted.  The  coefficient  of  the  group  grade  4  is  not  significant  because 
group  grade  4  is  already  the  top  grade  in  the  service  and  there  is  no  promotion  from  this 
grade.  Employees  who  receive  the  best  average  rating  (l=outstanding  or  2=exceeds  fully 
successful)  have  the  expected  positive  effect  on  promotion,  but  the  coefficient  is  not 
significant.  This  suggests  that  performance  ratings  are  not  important  in  determining 
promotion.  This  is  contrary  to  the  expectation  that  the  best  ratings  would  affect  the 
promotion  probability.  Another  surprising  result  is  that  none  of  the  sex  and  ethnicity 
variables  are  significant.  This  also  contradicts  the  studies  of  Usan  and  Utoglu  [Ref:7]  and 
Asch  [Ref:8].  Employees  in  functional  areas  of  Training,  Medical,  and  Headquarters  are 
4.18%,  8.16%  and  8.30%,  respectively,  less  likely  to  be  promoted  than  employees  in  the 
Material  functional  area. 

The  survival  results  in  Table  19  are  consistent  with  the  results  of  the  logit  model. 
In  the  time  to  first  promotion  model,  employees  with  a  Master’s  or  Doctorate  are  18.10% 
(1-0.819,  the  hazard  ratio)  and  0.434%  (1-0.566)  less  likely  (slower)  to  be  promoted, 
respectively.  In  the  time  to  second  promotion  model,  employees  with  a  Master  or 
Doctorate  degree  are  13.2  %  (1-  0.868)  and  34.9%  (1-0.651)  less  likely  to  be  promoted, 
respectively.  In  both  survival  models,  one  additional  year  of  prior  experience  decreases 
the  promotion  probability  by  1.6%  and  0.4%,  respectively.  In  both  survival  models, 
employees  in  functional  areas  of  Training  and  Medical  are  less  likely  to  be  promoted, 
while  employees  in  functional  areas  of  Intelligence  and  Administrative  activities  are 
more  likely  to  be  promoted.  The  surprising  results  are  that  none  of  the  sex  and  ethnicity 
variables  are  significant.  Another  unexpected  result  is  that  employees  with  good  ratings 
(outstanding  or  exceeds  fully  successful)  are  less  likely  to  be  promoted  in  both  models. 
However,  cumratl  variable  in  time  to  second  promotion  has  the  expected  positive  effect 
on  promotion. 


55 


Table  19,  Results  of  Time  to  First  and  Second  Promotion 


Time  to  First  Promotion  Time  to  Seeond  Promotion 


Independent 

Variables 

Parameter 

Estimates 

Standard 

Error 

Risk 

Ratio 

Parameter 

Estimates 

Standard 

Error 

Risk 

Ratio 

Female 

0.0350 

0.0361 

1.036 

0.0677** 

0.0036 

1.070 

Black 

0.0267 

0.0527 

1.027 

-0.0198 

0.0534 

0.980 

Hispanic 

-0.0189 

0.0844 

0.981 

-0.0665 

0.0860 

0.936 

Otherace 

0.0436 

0.0493 

1.045 

0.0318 

0.0495 

1.032 

Veteran 

-0.0423 

0.0694 

0.959 

-0.0355 

0.0682 

-0.965 

MA86 

-0.1994* 

0.0498 

0.819 

-0.1324* 

0.0497 

0.876 

PH86 

-0.5688* 

0.0977 

0.566 

-0.4286* 

0.1005 

0.655 

Supervisor 

-0.3281* 

0.1058 

0.720 

0.0256 

0.1015 

1.026 

Priexp 

-0.0165* 

0.0023 

0.984 

0.0439 

0.0024 

0.996 

Admin 

0.1071* 

0.0409 

1.113 

-0.0386 

0.0409 

0.962 

Technical 

-0.1582* 

0.0678 

1.172 

0.0428 

0.0684 

1.043 

Clerk 

0.4961* 

0.0636 

1.642 

0.3061* 

0.0598 

1.358 

Otherwc 

0.5959* 

0.2162 

1.815 

0.4800** 

0.2157 

1.616 

Fleet 

-0.2178* 

0.0652 

0.804 

-0.2698* 

0.0673 

0.764 

Intel 

0.0743* 

0.0630 

1.077 

0.1162** 

0.0647 

1.123 

Trainning 

-0.1685* 

0.0889 

0.845 

-0.2200** 

0.0929 

0.802 

Medical 

-0.1142* 

0.0983 

0.892 

-0.0258 

0.1009 

0.974 

Headqrt 

-0.0547* 

0.0980 

0.947 

0.0742 

0.0951 

1.077 

Adminact 

0.1208* 

0.0378 

1.129 

0.1062 

0.0372 

1.112 

Cumratl 

-0.0543 

0.0544 

0.947 

0.0502** 

0.0199 

0.951 

Cumrat2 

-0.0223 

0.0442 

0.978 

-0.0181 

0.0178 

0.981 

Timel 

0.3249* 

0.0091 

1.385 

Grade 

0.1187* 

0.0064 

1.126 

0.1225* 

0.0042 

1.130 

%  Censored  3.52 

-2LogL  69939.215 

%Censored  5.94 

-2  Log  L  67368.248 

*  Significant  at  thel%  level 

**  Significant  at  the  5%  level 


C.  RESULTS  OF  RETENTION  MODELS 

Two  retention  models  were  created  to  analyze  the  effect  of  graduate  education  on 

the  retention  of  DoD  civilian  employees  with  the  expectation  that  the  employees  would 

act  as  utility  maximizers.  Theory  supports  the  view  that  employees  would  prefer  to  stay 

56 


in  the  DoD  civilian  service  if  their  gain  within  the  service  exceeds  their  gain  in  the 
private  sector. 

The  first  retention  model  uses  a  binary  logit  technique  for  employees  hired  in 
1986.  In  this  model,  employees  are  followed  until  1992  to  see  whether  they  are  still  in  the 
service  or  not.  If  they  are  still  in  the  service,  the  dependent  variable  is  coded  1 ;  otherwise 
it  is  coded  0. 

The  second  retention  model  is  a  survival  model  based  on  a  Cox  regression.  In  this 
model,  the  time  to  separation  is  estimated.  The  data  sample  contains  employees  hired  in 
1986.  These  employees  are  tracked  until  1999,  the  end  of  the  data.  During  this  14  year- 
period,  snapshots  of  employees  were  taken  every  two  years,  except  for  the  last  year, 
1999.  Since  Cox  regression  also  considers  censored  elements,  employees  who  are  not 
separated  at  the  end  of  the  data  are  used  to  indicate  censored  data,  while  the  dependent 
variable  of  the  time  to  separation  in  years  is  determined  by  the  employees’  service  years 
in  DoD  before  separation. 

The  “goodness  of  fit”  of  the  models  can  be  examined  again  by  the  -2  Log  L 
values.  The  logit  model  has  the  -2  Log  L  value  of  7418.591  with  p<.000L  The  survival 
model  for  retention  has  the  -2  Log  L  value  of  58654.031  with  p<.000L  Also  the 
Classification  Table  of  the  logit  model  predicts  77.60  percent  of  the  “events”  and  “non- 
events”  correctly.  Based  on  these  results,  the  models  have  explanatory  power. 

In  the  logit  model  results  in  Table  20,  15  variables  out  of  20  are  significant  except 
for  Hispanic,  Veteran,  Intel,  Admin,  and  Supervisor  variables.  The  variables  have  the 
expected  results.  For  example,  employees  with  a  Master’s  or  Doctorate  are  5.59%  and 
6.39%,  respectively,  less  likely  to  stay  in  the  DoD  service.  Female  employees  are  also 
5.36%  less  likely  to  stay  in  the  service  than  male  employees.  On  the  other  hand.  Black 
and  Otherrace  employees  are  more  likely  to  stay  in  the  service  than  whites.  As  expected 
older  employees  are  more  likely  to  stay.  However,  employees  in  all  functional  areas  are 
less  likely  to  stay  in  the  service  than  employees  in  material  functional  area.  Similarly, 
employees  in  all  occupations  except  for  administrative  occupation  are  less  likely  to  stay 
in  the  service  than  employees  in  professional  occupations.  As  expected  in  other  studies, 
employees  who  get  higher  performance  ratings  are  more  likely  to  stay  in  the  service. 
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Table  20,  Results  of  Binary  Logit  Retention 


Independent 

Variables 

Parameter 

Estimates 

Standard 

Error 

Partial 

Effects 

Intereept 

-4.1000* 

0.2495 

Female 

-0.3454* 

0.0703 

-0.0536 

Black 

0.3344* 

0.1043 

0.0430 

Hispanic 

-0.1081* 

0.1563 

-0.0161 

Otherace 

0.5871* 

0.1118 

0.0693 

Veteran 

0.0464 

0.1406 

0.0065 

Age86 

0.0172* 

0.0044 

0.0024 

MA86 

-0.3478* 

0.0958 

-0.0559 

PH86 

-0.3923** 

0.2056 

-0.0638 

Supervisor 

-0.2890 

0.1954 

-0.0456 

Admin 

0.0736 

0.0832 

0.0103 

Technical 

-0.2104** 

0.1222 

-0.0324 

Clerk 

-0.3483* 

01090 

-0.0560 

Otherwc 

-1.2064* 

0.3394 

-0.2394 

Fleet 

-0.9859* 

0.1266 

-0.1871 

Intel 

-0.1784 

0.1381 

-0.0272 

Trainning 

-1.0849* 

0.1471 

-0.2103 

Medical 

-1.8033* 

0.1364 

-0.3874 

Headqrt 

-0.8892* 

0.1789 

-0.1606 

Adminact 

-1.0849* 

0.0076 

-0.0384 

Ratingtop 

1.3829 

0.0589 

0.1240 

-2LogL  7418.591* 

Chi-Sq  1084.596* 

*  Significant  at  the  1%  level 
**Signifieant  at  the  5%  level 

Ratingtop  variable  is  reversed  for  statistical  purposes. 


In  the  Cox  regression  model  of  retention  in  Table  21,  similar  results  are  found. 
For  example,  employees  with  a  Master’s  or  Doctorate  are  15.7%  and  25.3%,  respectively, 
more  likely  to  leave  the  federal  serviee  than  employees  with  a  Baehelor  degree.  Again 
employees  who  receive  the  best  performance  ratings  are  less  likely  to  leave  the  serviee. 
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Table  21.  Cox  Regression  of  Time  to  Separation 


Independent 

Variables 

Parameter 

Estimates 

Standard 

Error 

Risk 

Ratio 

Female 

0.34811* ** 

0.0388 

1.416 

Black 

-0.2958* 

0.0569 

0.744 

Hispanic 

0.0799 

0.0844 

1.083 

Otherace 

-0.3985* 

0.0628 

0.671 

Veteran 

-0.1074* 

0.0726 

0.898 

Age86 

-0.0071* 

0.0023 

0.993 

MA86 

0.1454* 

0.0521 

1.157 

PH86 

0.2258* 

0.1155 

1.253 

Supervisor 

0.2932* 

0.0910 

1.341 

Admin 

-0.0159 

0.0470 

0.984 

Technieal 

0.2457* 

0.0601 

1.282 

Clerk 

0.1543* 

0.0564 

1.167 

Otherwe 

0.4788* 

0.1876 

1.614 

Fleet 

0.6623* 

0.0570 

1.939 

Intel 

0.5755* 

0.0680 

1.778 

Trainning 

0.7338* 

0.0825 

2.083 

Medical 

0.9757* 

0.0717 

2.653 

Headqrt 

0.4764* 

0.1073 

1.610 

Adminact 

0.0749 

0.0461 

1.075 

Cumratl 

-2.6935* 

0.0845 

0.068 

Cumrat2 

-1.3891* 

0.0729 

0.249 

%  Censored  49.19 

-2LogL  58654.031* 

Chi-Sq  1892.240* 

*  Significant  at  the  1%  level 

**  Significant  at  the  5%  level 


D,  THE  RESULTS  OF  PERFORMANCE  RATING  MODELS 

As  explained  in  Chapter  IV,  performance  ratings  are  not  perfeet  in  measuring 
employees’  performance,  but  they  provide  some  information  about  the  overall 
performance  of  the  employees.  In  estimating  the  relative  performance  of  employees,  two 
different  models  are  estimated.  The  first  model  analyzes  the  pereentage  of  “Outstanding” 
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ratings  received  by  employees  hired  in  1986  over  their  service  period.  In  other  words,  this 
ratio  is  calculated  for  all  of  the  times  that  the  employees  are  evaluated  for  their 
performance.  There  are  7,811  observations  for  this  model.  The  dependent  variable  is  the 
ratio  of  cumulative  rating  1  (Outstanding)  over  total  ratings  and  the  model  is  estimated  by 
OLS.  The  second  model  estimates  the  probability  of  becoming  a  supervisor.  This  model 
assumes  that  the  better  performing  employees  will  be  given  a  supervisor  position  and  will 
be  promoted  to  higher  grades.  Therefore,  the  binary  logit  model  is  used  to  estimate  the 
probability  of  being  selected  for  a  supervisor  position. 

The  “goodness  of  fit”  of  the  first  regression  model  is  examined  by  the  R^,  the 
coefficient  of  determination,  which  is  .0410.  Also  the  overall  significance  of  the 
regression  model  can  be  measured  by  the  F  value  of  the  model.  As  long  as  the  F-value  is 
significant,  then  the  null  hypothesis  that  there  is  no  power  of  the  model  is  rejected.  In  this 
model  the  F  value  of  18.52  is  significant  at  the  P>.0001  level.  The  “goodness  of  fit”  of 
the  logit  model  for  being  placed  in  a  supervisor  job  can  be  measured  by  the  -  2  Log  L 
value  which  is  2165.949  with  p=.0001.  This  shows  us  that  the  model  has  some 
explanatory  power.  The  classification  table  of  the  model  also  correctly  predicts  88.3%  of 
the  “events”  and  “non-events”  of  the  model  at  0.6  “cut-off’  point. 

In  the  first  model  in  Table22  employees  with  a  Master’s  or  Doctorate  are  2%  and 
9.32%,  respectively,  more  likely  to  obtain  the  highest  performance  ratings  than 
employees  with  a  Bachelor’s  degree.  Also  Black,  Hispanic,  and  other  race  employees  in 
the  federal  service  are  less  likely  to  obtain  the  top  ratings  compared  to  whites. 

In  the  logit  model  for  the  probability  of  being  a  supervisor,  results  are  consistent 
with  the  first  model  for  example,  employees  with  a  Master’s  or  Doctorate  are  8.8%  and 
16.8%,  respectively,  more  likely  to  be  a  supervisor  when  the  top  rating  variable  is 
excluded  from  the  model.  However,  when  the  top  rating  variable  (Cumrat)  is  included  in 
the  model  the  effect  of  a  Master’s  or  Doctorate  dropped  to  4.96%  and  8.84%, 
respectively. 
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Table  22,  Results  of  OLS  Performance  Rating  Model 


Independent 

Parameter 

Standard 

Variables 

Estimates 

Error 

Intercept 

0.1216* 

0.0047 

Female 

0.0089 

0.0055 

Black 

-0.0224* 

0.0082 

Hispanic 

-0.0258** 

0.0128 

Otherace 

-0.0216** 

0.0085 

Veteran 

0.0572* 

0.0100 

MA86 

0.0201* 

0.0073 

PH86 

0.0932* 

0,0156 

Supervisor 

0.0645* 

0.0141 

Admin 

0.0235* 

0.0065 

Technical 

-0.0240* 

0.0091 

Clerk 

0.0049 

0.0811 

Otherwc 

-0.0298 

0.0283 

Fleet 

0.0052 

0.0083 

Intel 

0.0243** 

0.0109 

Trainning 

0.1123* 

0.0130 

Medical 

0.0492* 

0.0113 

Headqrt 

0.0106* 

0.0144 

Adminact 

-0.0194* 

0.0619 

Sample  Size 

7811 

.041 

F  Value 

18.52 

*  Significant  at  1  percent  level 

**  Significant  at  5  percent  level 
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Table  23,  Logit  Model  of  Achieving  Supervisor  Status 


Rating  not  Included _ _ Rating  Included 


Independent 

Variables 

Parameter 

Estimates 

Standard 

Error 

Partial 

Effects 

Parameter 

Estimates 

Standard 

Error 

Partial 

Effects 

Intercept 

-2.1244* 

0.1054 

-2.7918* 

0.1502 

Female 

-0.0367 

0.1452 

-0.0034 

-0.0804 

0.1473 

-0.0042 

Blaek 

-0.6430* 

0.2472 

-0.0476 

-0.5519* 

0.2502 

-0.0236 

Hispanic 

0.0429 

0.3146 

0.0042 

0.1194 

0.3210 

0.0069 

Otherace 

-0.5233* 

0.2159 

-0.0406 

-0.3689** 

0.2184 

-0.0170 

Veteran 

0.8922* 

0.1874 

0.1191 

0.8946* 

0.1910 

0.0727 

MA86 

0.7050* 

0.1523 

0.0880 

0.6734* 

0.1549 

0.0496 

PH86 

1.1545* 

0.2495 

0.1681 

1.0269* 

0.2524 

0.0884 

Admin 

0.0503 

0.1490 

0.0049 

0.0427 

0.1511 

0.0024 

Teehnieal 

-0.2404 

0.2929 

-0.0192 

-0.2741 

0.2463 

-0.0132 

Clerk 

-1.3058* 

0.3093 

-0.0754 

-1.3136* 

0.3108 

-0.0414 

Otherwe 

-0.2191 

0.7911 

-0.0192 

-0.3383 

0.8057 

-0.0158 

Fleet 

1.1760* 

0.1963 

0.1725 

1.0358* 

0.2001 

0.0895 

Intel 

0.2140* 

0.3242 

0.0222 

0.0708 

0.3279 

0.0040 

Trainning 

0.3673 

0.2813 

0.0404 

0.2515 

0.2853 

0.0153 

Medical 

0.3347 

0.3314 

0.0364 

0.1555 

0.3349 

0.0091 

Headqrt 

0.1220 

0.3254 

0.0122 

0.0730 

0.3280 

-0.0037 

Adminact 

-0.4036* 

0.1562 

-0.0328 

-0.3066** 

0.1580 

-0.0145 

Cumrat 

1.0171* 

0.1428 

0.0872 

-2LogL  2165.949* 

Chi-Sq  174.374* 

-2LogL  2165.949* 

Chi-Sq  231.273* 

*  Significant  at  the  1%  level 

**  Signilieant  at  the  5%  level 
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IV.  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  CONCLUSIONS 

This  thesis  analyzed  the  relationship  between  graduate  edueation  and  the  job 
performanee  of  DoD  eivilian  employees.  In  the  thesis,  four  proxy  performanee  measures 
(salary,  promotion,  retention,  and  performanee  ratings)  were  used  to  gauge  the  effeet  of 
advaneed  education  on  employee  productivity.  The  results  in  these  models  are  generally 
consistent  with  previous  studies. 

First  of  all,  employees  with  a  Master’s  or  Doctorate  at  entry  have  lower  real 
salary  growth  rates  increases  than  employees  with  only  a  Bachelor’s  degree.  However, 
when  the  GS  entry  grades  are  included  in  the  model,  the  effect  of  graduate  education  on 
real  salary  growth  rate  became  positive  indicating  higher  growth  rates  for  employees  with 
graduate  degrees.  In  the  second  model  of  annual  average  salaries,  the  results  are  as 
expected  and  show  that  employees  with  a  Master’s  or  Doctorate  earn  more  on  average 
than  employees  with  a  Bachelor’s.  However,  when  GS  entry  grades  are  included  in  the 
model  the  effect  of  graduate  education  became  negative.  This  result  was  surprising  and 
may  be  explained  by  the  shorter  tenure  of  employees  with  a  Master’s  or  Doctorate  in  the 
DoD  civilian  service.  All  of  these  results  are  somewhat  consistent  with  the  Usan  and 
Utoglu  study  [Ref:7]  and  Asch  [Ref:8]. 

In  analyzing  promotion  outcomes,  two  different  measures  are  used.  The  first  one 
measures  the  promotion  probability,  and  the  second  one  measures  promotion  speed.  In 
the  promotion  probability  model,  employees  with  a  Master’s  or  Doctorate  are  less  likely 
to  be  promoted.  In  the  promotion  speed  model,  the  results  indicate  employees  with  a 
Master’s  or  a  Doctorate  are  slower  to  attain  a  promotion  than  employees  with  a 
Bachelor’s  degree.  Usan  and  Utoglu  found  similar  results  indicating  that  the  effect  of 
graduate  education  on  the  promotion  probability  was  lower.  Asch  also  suggested  that 
even  though  employees  with  a  Bachelor’s  degree  promoted  faster,  it  does  not  always 
mean  that  advanced  education  slows  the  pace  of  promotions.  Surprisingly,  the  results 
here  show  that  having  top  performance  ratings  does  not  affect  the  speed  of  first 
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promotion.  However,  reeeiving  top  performanee  ratings  does  have  a  positive  effect  on  the 
second  promotion  speed. 

The  results  of  both  binary  logit  and  Cox  regression  analyses  of  retention  are 
consistent  with  previous  studies  of  DoD  civilian  employees.  Previous  analyses  found  that 
the  effect  of  personnel  quality  and  education  on  retention  is  ambiguous  and  cannot  be 
predicted  a  priori  since  higher  qualified  personnel  have  better  opportunities  both  inside 
and  outside  the  federal  service.  In  the  binary  logit  model,  employees  with  a  Master’s  or 
Doctorate  are  5.38%  and  6.69%,  respectively,  more  likely  to  leave  the  service.  Similarly, 
in  Cox  regressions  of  time  to  separation,  employees  with  a  Master’s  or  Doctorate  leave 
federal  service  15.7%  and  25.3%,  respectively,  sooner  than  employees  with  a  Bachelor’s 
degree.  The  Cox  regression  model  gives  similar  results.  As  in  previous  studies, 
employees  with  good  performing  ratings  are  more  likely  to  stay  in  the  service  since 
superior  rating  indicates  a  good  match  between  employees  and  the  job  has  been 
established. 

The  results  of  a  binary  logit  model  for  being  a  supervisor  and  a  regression  model 
for  the  percent  of  top  ratings  both  indicate  that  employees  with  higher  education  are  more 
likely  to  be  a  supervisor  and  to  receive  higher  performance  ratings  in  the  federal  service. 

In  summary,  employees  with  a  Master’s  or  Doctorate  gain  more  and  receive 
higher  salary  increases  in  the  service.  However,  employees  with  a  Master’s  or  Doctorate 
are  promoted  slower  since  they  are  placed  at  the  higher  GS  grades  at  entry  in  the  service, 
which  hinders  subsequent  promotion.  Even  though  employees  with  a  Master’s  or  a 
Doctorate  receive  the  best  performance  ratings  and  are  more  likely  to  be  selected  as 
supervisors,  they  leave  the  service  earlier  than  other  employees.  This  result  supports  the 
concept  that  the  incentives  of  the  outside  market  exceed  the  incentives  inside  the  federal 
service  for  more  highly  educated  employees. 


64 


B,  RECOMMENDATIONS 

Initially,  a  new  data  set  should  be  gathered  for  further  researeh  to  see  more  reeent 
ehanges  in  the  DoD  civilian  service.  Some  miscoding  or  some  flaws,  especially  in  the 
education  levels,  the  performance  ratings,  and  the  annual  salaries  of  personnel  data  file 
exist  in  the  DMDC  file.  The  new  data  set  should  provide  information  on  the  source  of 
education,  namely,  whether  the  employees  paid  for  higher  education  or  whether  DoD 
shared  the  cost  of  education.  By  basing  the  effect  of  graduate  education  on  the  source  of 
education  the  results  can  be  more  informative  for  personnel  policy  changes. 

Secondly,  any  bonuses,  which  the  employees  received  in  a  year,  should  be  added 
to  the  personnel  data  so  that  the  effect  these  bonuses  have  on  retention  can  be  measured 
and  the  relationship  between  the  earnings  and  retention  can  be  evaluated  for  the  purpose 
of  keeping  higher  quality  employees  in  the  service.  Also  each  occupation  must  be 
compared  to  the  civilian  counterparts  in  terms  of  earnings  or  earnings  increase  in  each 
year  so  that  personnel  managers  can  take  precautions  to  keep  higher  quality  personnel 
from  leaving. 

Finally,  research  should  be  conducted  on  whether  the  retention  of  higher-level 
personnel  is  sufficient  to  meet  current  and  future  personnel  requirements.  In  this  analysis 
higher  educated  personnel  are  more  likely  to  leave  the  service  early.  How  does  this 
behavior  affect  the  requirements  of  each  occupation?  Future  research  should  also  conduct 
a  cost-benefit  analysis  of  the  higher  educated  personnel  to  fill  the  gaps  or  requirements 
from  outside  the  service  or  within  the  service. 
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APPENDIX  DEFENSE  CIVILIAN  PERSONNEL  DATA  FILE  LA  YOUT  (8609  THROUGH  9902) 
(DA  T  A  ELEMENTS  USED  IN  THE  THESIS) 


(Source:  Defense  Manpower  Data  Center 
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